ODC  flLE  COPY  /\DA042034 


SCME  RESULTS  ON  SYMCTRIC  STABLE 
DISTRIBUTICNS  AND  PROCESSES* 


Grady  W.  Miller 


Department  of  Statistics 
University  of  North  Carolina  at  Chapel  Hill 


Institute  of  Statistics  Mimeo  Series  No.  1121 


May,  1977 


*This  research  was  supported  in  part  by  the  Air  Force  Office  of  Scientific 
Research  under  Grant  AFOSR-75-2796. 


■* 


J 


OB'  SCKStlHC  UW"®* 
[Co'cF  TBASSMITT*^ 

3 '‘'"rsl'easo  IA«  “® 

--•S'"  S 

;',ritut.ion  IS  uu 
C.  BLOSE  ^ 

,y,nical  infonnatlon 


lAl' 

and  ia 
■ 12  l,7b\» 


I 


security  classification  of  This  page  (Whu,  nma 

i. O 

REPORT  DOCUMENTATION  PAGE 


I Ap6r-R  '7  - t/7  1 3 


2.  GOVT  ACCESSION^ 


TITLE  (eayd  Subtitle) 


(kj  j 


SOME^RESULTS  ON  SYMMETRIC  STABLE  DISTRIBUTIONS 

AND  processes  ^ '''  ' 

i I ' ' {.  f ) 


Grady 


W .filler  j 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


V/  ■ / 


y Mimeo  SerJhM—1121 

J — cowowoe^  ew  >w*wT  wo<l 

AFOSR  75-2796 


ORTI  NUMBER 


9.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

University  of  North  Carolina 
Department  of  Statistics 
Chapel  Hill,  NC  27514 

11.  CONTROLLING  OFFICE  NAME  AND  ADDRESS  . 

Air  Force  Office  of  Scientific  Research/NM  /// 
Bolling  AFB,  Washington,  DC  20332 


10.  PROGRAM  element,  project,  TASK 
AREA  « tHjmi  UNIT  NUMBERS 


61102H'^3^/a5 


May  JS77 


U.  MONITORING  AGENCY  NAME  A ADDRESSCIf  dlllarani  from  ConIrolUnt  Ollica)  I 15.  SECURITY  CLASS.  (ol  Ihia  rapott) 


UNCLASSIFIED 

15«.  DECLASSIFICATION  DOWNGRADING 
SCHEDULE 


I IS.  distribution  STATEMENT  (ol  thia  Raport) 


Approved  for  public  release;  distribution  unlimited. 


M /fIF-  / 


SMENT  (of  the  mbetrect  entered  in  Block  20,  If  different  from  Report) 


1 18.  supplementary  notes 


19.  KEY  WORDS  fCon(/nu»  on  reverse  eide  If  neceeamty  end  Identify  by  block  number) 

symmetric  stable  distribution,  moments,  linear  regression, 
stochastic  integral,  system  identification,  measurable  stochastic 
process,  path  properties 

2p  ABSTRACT  fConiinu*  on  reverse  aide  If  neceesmry  snd  Identify  by  bfocit  number) 

for  s>'mmetric  stable  random  varinble.s,  a condition  equivalent  to  linear  regres- 
sion is  obtained  and  moments  of  cert.iin  monomials  arc  com|inteil.  For  stochastic 
[irocesscs  of  random  variables  with  p-th  moments,  p^l,  a function  space  approach 
is  developed  and  applied  to  the  system  identification  problem.  Conditions  for 
measurable  modifications  and  for  integrable  or  absolutely  continuous  sample  j 
paths  are  given.  I 


DD  I JAN *73  1473  edition  OF  1 NOV  65  IS  OBSOLETE 


UNCLASSIFIED 

SECURITY  CLASIlFtCATlOH  OF  THIS  PACE  fWi»n  r»l» 


MILLER,  GRADY.  Some  Results  on  Symmetric  Stable  Distributions  and 
Processes.  (Under  the  direction  of  STAMATIS  CAMBANIS.) 

This  work  investigates  properties  of  symmetric  stable  distribu- 
tions and  stochastic  processes.  A necessary  and  sufficient  condition 
is  presented  for  a regression  involving  symmetric  stable  random 
variables  to  be  linear.  We  introduce  the  notion  of  n-fold  dependence 
for  symmetric  stable  random  variables  and  under  this  condition  char- 
acterize all  monomials  in  such  randan  variables  for  which  moments  exist. 

A function  space  approach  to  symmetric  stable  stochastic  processes  is 

t 

developed  and  applied  to  the  problem  of  system  identification.  Neces- 
sary and  sufficient  conditions  are  given  for  the  existence  of  measurable 
modifications  of  such  processes  and  for  the  almost  sure  integrability 
and  absolute  continuity  of  sample  paths. 


Introduction  and  Summary 1 

I.  Independence,  Regression,  and  Moments 

1.  Fundamental  definitions  and  characterizations 4 

2.  Independence 9 

3.  Regression 15 

4.  Nfoments 30 

II.  A Function  Space  Approach  to  SaS  Processes 


1.  The  linear  space  of  a process 

2.  The  integral  /f(t)d^^ 

3.  The  integral  /f(t)dC^  when  5 is  SaS  with  independent 

increments 

4.  Spectral  representation  of  a SaS  process — 

5.  The  integral  /f(t)C^v(dt) 

6.  The  integral  /f(t)C^v(dt)  when  C is  SaS  with  indepen- 

dent increments 


7.  System  identification 

III.  Path  Properties 

1.  Measurability  of  p-th  order  processes 

2.  Integrability  of  sample  paths  of  SaS  processes 

3.  Absolute  continuity  of  sample  paths 


42 

53 

58 

64 

67 

74 

78 

91 

98 

103 


INTRODUCTION  AND  SUMMARY 


It  is  well  known  that  the  stable  laws  arise  naturally  as  the  limiting 
distributions  of  normed  sums  of  independent  identically  distributed 
random  variables  (or  vectors) , and  this  result  has  been  extended  to 
Banach  space  valued  random  variables  ([Kumar  and  Mandrekar  1972])  as 
well  as  to  random  variables  with  values  in  certain  topological  vector 
spaces  ([Rajput  1975]).  The  limiting  distributions  that  have  infinite 
variance  can  be  typed  by  a parameter  a,  0 < a < 2,  and  only  absolute 
moments  of  order  strictly  less  than  a are  finite,  whereas  in  the  finite 
variance  case  (a  = 2)  the  limiting  distribution  is  always  normal  and 
all  moments  exist.  Even  though  stable  laws  on  the  real  line  are  abso- 
lutely continuous,  closed  form  expressions  for  their  density  functions 
are  known  in  only  a few  cases.  In  contrast,  the  characteristic  functions 
of  stable  measures  on  finite  or  infinite-dimensional  spaces  are  quite 
sinple  ([Kuelbs  1973])  and  therefore  constitute  a primary  tool  in  our 
research. 

Many  easily  formulated  problems  involving  stable  distributions  on 
Euclidean  n-space  remain  unsolved,  and  the  study  of  multivariate  stable 
distributions  is  continually  being  renewed  (as  in  [Hosoya  1976] ).  Since 
the  normal  distributions  have  been  extensively  investigated,  our  efforts 
are  directed  mainly  toward  stable  distributions  that  have  0 < a < 2 and 
(for  simplicity)  that  are  symmetric.  If  the  symmetric  stable  random 
variables  are  defined  on  a probability  space  (fl,F,P),  then  they  belong 


2 


to  the  conplete  metric  space  where  0<p<a<2in  the  infinite 

variance  case  and  to  the  Hilbert  space  L2(S1,F,P)  in  the  normal  case.  Our 
basic  approach  is  to  extend  results  known  for  normal  distributions  to 
symmetric  stable  distributions,  and  many  of  the  difficulties  which  arise 
are  due  to  the  more  complicated  structure  of  Lp  spaces  and  (for  p 2 1)  the 
lack  of  a sinple  representation  for  the  dual  elements  such  as  exists  for 
an  inner  product  space.  Consequently  our  development  often  originates 
with  p-th  order  random  variables  and  then  is  narrowed  to  include  only 
symmetric  stable  randcmi  variables.  One  of  the  most  notable  advantages 
of  specializing  to  the  stable  case  is  that  here  the  notion  of  independence 
provides  a satisfactory  and  useful  analogy  to  the  concept  of  orthogonality 
for  random  variables  with  finite  second  moments. 

Suimiary 

The  first  chapter  begins  with  basic  definitions  and  characterizations 
on  infinite-dimensional  spaces,  but  deals  mostly  with  problems  in  an  n- 
dimensional  Euclidean  space  setting.  The  principal  results  give  necessary 
and  sufficient  conditions  for  independence  of  random  vectors,  linear  re- 
gression, and  finite  absolute  moments  of  monomials. 

In  the  second  chapter  we  study  the  structure  of  the  linear  space  of 
a symmetric  stable  process  (a  > 1)  and  use  this  structure  to  represent 
elements  in  the  linear  space  (under  certain  conditions)  as  stochastic 
integrals  of  elements  of  a function  space  (or  A^) . Conditions  for 
independence,  best  linear  approximations,  and  expressions  for  dual  elements 
are  obtained  in  terms  of  these  representations.  These  results  are 
applied  to  the  problem  of  linear  system  identification  when  the  input  is 
a synmetric  stable  process. 


The  final  chapter  contains  necessary  and  sufficient  conditions 
for  the  measurability  of  p-th  order  or  symmetric  stable  processes  and 
for  the  integrability  or  absolute  continuity  of  sairf)le  paths  of  symmetric 
stable  processes,  as  well  as  sufficient  conditions  for  absolute  continuity 
of  sample  paths  of  p-th  order  processes. 


I.  INDEPENDENCE,  REGRESSION,  AND  MOMENTS 
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Multivariate  stable  distributions  and  their  characteristic  functions 
have  been  known  and  studied  for  many  years,  but  the  subject  continues 
to  attract  the  attention  of  researchers  [e.g. , [Press  1972,  Paulauskas 
1976]).  Still  unanswered  are  some  quite  natural  questions  surrounding 
such  topics  as  the  properties  of  conditional  distributions  or  the  effects 
of  nonlinear  transformations  on  stable  distributions.  In  the  first  two 
sections  of  this  chapter  we  discuss  definitions  and  results  that  will 
be  of  use  to  us  later,  and  in  the  latter  two  we  present  some  develop- 
ments on  regression  analysis  and  moments  for  jointly  symmetric  stable 
random  variables. 

1 . Fundamental  definitions  and  characterizations . 

In  this  section  we  define  a stable  measure  on  a Banach  space  and 
state  some  characterizations  of  the  characteristic  function  (c.f.)  of 
a symmetric  stable  measure  on  a Hilbert  space.  This  material  is  well- 
known  for  stable  measures  on  n-dimensional  Euclidean  space  R^,  but  has 
only  recently  been  extended  to  infinite-dimensional  spaces.  Even  though 
we  shall  rarely  consider  stable  measures  on  spaces  other  than  R^,  the 
additional  generality  provided  here  will  occasionally  be  needed. 

Let  E be  a real  separable  Banach  space  and  for  every  aeR  define 
the  continuous  map  T : E -♦  E by  T„(x)  = ax.  A probability  measure  y 
on  the  Borel  subsets  of  E is  said  to  be  stable  if  for  any  a > 0 and 
b > 0 there  exists  c > 0 and  x e E such  that 


; 
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(nT'^J  ® (pT^^)  = (pT'b  ® 6^  , 


where  6^  is  the  Borel  probability  measure  satisfying  6^({x})  = 1 and 
® denotes  the  convolution  operation. 

Let  E*  be  the  dual  space  of  E and  C be  the  space  of  complex  numbers. 
The  c.f.  of  a Borel  probability  measure  y on  E is  a map  y:  E*  -»■  C de- 


fined by 


J(w)  . / e“WKdx) 
E 


for  all  wcE*.  It  has  been  shown  ([It6  ^d  Nisio  1968]).  that  a Borel 
probability  measure  on  a real  separable  Banach  space  is  uniquely  deter- 
mined by  its  c.f.  The  following  characterization  of  a stable  measure 
is  given  by  [Kumar  and  Mandrekar  1972]  and  [Rajput  1975] . 


1.1.1  A Borel  probability  measure  on  a real  separable  Banaah  space 
E is  stable  if  and  only  if  for  every  integer  n > 1 there  exists  x^^eE 


such  that 


, , iwfx  ) 
[y[w)]”  = y(n  “w)e 


for  every  weE*,  where  a is  uniquely  determined  by  y and  satisfies 

0 < a < 2. 


It  is  customary  to  say  that  the  measure  y is  a-stable  whenever  the 
condition  in  1.1.1  holds.  A measure  y on  E is  said  to  be  s>’mmetric  if 
y[B)  = y(-B)  for  every  Borel  set  B.  For  a symmetric  a-stable  (SaS) 
measure  y we  have  x^  = 0 in  1.1.1  for  all  n.  It  is  straightforward 
to  chock  that  y is  a SaS  measure  on  E if  and  only  if  yw  ^ is  a SaS 
measure  on  R for  everv’  weE*. 
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Let  us  restrict  attention  to  SaS  measures  on  a real  separable  Hilbert 
space  H with  inner  product  and  unit  sphere  S = {xeH;^x,x^  = 1). 

Then  the  SaS  c.f.  is  characterized  in  [Kuelbs  1973,  Corollary  2.1]. 


1.1.2  A map  ;{i:  H ->■  R is  the  a.f.  of  an  SaS  measure  on  H if  and  only 
if  it  can  he  written  in  the  form 

(j)(y)  = exp{-  / l^x,y^)“r(dx) } 

for  every  yeH,  where  V is  a finite  symmetric  Boret  measure  on  S. 

If  H = and  0 < a < 2,  then  the  symmetric  measure  r on  S is  uniquely 

determined  by  the  SaS  measure  ([Kanter  1973,  Lemma  1]),  and  we  shall  call 
r the  spectral  measure  of  the  SaS  distribution  (or  c.f.)  as  is  done  in 
[Paulauskas  1976,  p.  357].  If  a = 2,  then  <t>  is  the  c.f.  of  a Gaussian 
measure  (or  distribution) . Whenever  the  distribution  of  a random  vector 
(Cj,...,^^)  is  an  SaS  measure  on  R*^,  we  shall  refer  to  as 

jointly  SaS  random  variables. 

We  now  present  another  characterization  (also  due  to  Kuelbs)  of  the 

SaS  c.f.  on  H after  introducing  some  additional  terminology.  Let  t be 

1/2 

the  topology  induced  on  H by  the  seminorms  of  the  form  /Ty,y^  , where 
T is  a symmetric,  positive,  trace  class  operator  on  H.  An  even,  real- 
valued  function  f on  H satisf>'ing  f(0)  = 0 is  said  to  be  of  negative  type 

n 

I fCyi'yi^CjC.  < 0 

i.j=l  ' J " J 

for  all  n,  all  yj,...,y^€H,  and  all  real  numbers  Cj,...,c^  such  that 

=0.  If  f“  is  of  negative  tvqic  and  if  f(Xy)  = |x|f(y)  for  all 


real  A ‘and  yeH,  then  f is  called  a homogeneoun  negative-definite  function 
of  order  a. 

1.1.3  [Kuelbs  1973,  Theoran  3.1]  A map  (Ji:  H R is  the  c.f.  of  a SaS 
measure  on  H if  and  only  if  it  has  the  form 

(j>Cy)  = exp{-f“[y)}  , 

where  f is  a homogeneous  negative-definite  function  of  order  a which  is 
x-continuous  on  H. 

A stochastic  process  C = is  called  SaS  if  its  finite- 

dimensional distributions  are  SaS.  When  a = 2,  ^ is  a zero  mean  Gaussian 
process  and  its  statistical  properties  can  be  expressed  in  terms  of  a 
single  function,  the  covariance  function.  However,  when  0 < a < 2,  there 
is  in  general  no  simple  parametric  description  of  the  finite-dimensional 
distributions  of  the  process. 

A special  class  of  SaS  stochastic  processes  which  are  closely  related 
to  Gaussian  processes  and  which  have  an  equally  simple  parametric  descrip- 
tion are  the  so-called  sub-Gaussian  processes.  Nevertheless  the  sub- 
Gaussian  processes  have  quite  different  properties  from  the  a = 2 case, 
some  of  which  are  mentioned  in  [Bretagnolle,  et  al.  1966,  p.  251]. 

To  introduce  the  sub-Gaussian  process  we  begin  with  a zero  mean 
Gaussian  process  teT}  with  finite-dimensional  c.f. 's  of  the  form 

given  in  result  1.1.3:  for  every  n and  every  (tj , . . . ,t^^)  eT^, 


I n in 

where  f is  a homogeneous  negative-definite  function  of  order  2. 

^l’-‘*’  n 
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It  is  well  known  that  if  a function  ij/  is  of  negative  type,  then 
is  of  negative  type  for  all  p such  that  0 < p « 1 . (See  [Parthasarathy 
and  Schmidt  1972 J for  a general  discussion.)  Thus  it  follows  from 
1.1.3  that 

exp{-f“  ^ (r, ,...,r  )} 

is  an  SciS  c.f.  on  for  any  a such  that  0 < a < 2.  The  family  of  all 
such  SaS  c.f.'s,  for  n = 1,2,...  and  (t^, . . . ,tj^)£T^,  clearly  specifies  a 
consistent  family  of  finite-dimensional  distributions  and  hence  a stoch- 
astic process.  We  shall  use  the  term  a -sub -Gaussian  to  refer  to  finite- 
dimensional distributions  having  c.f.'s  of  this  form  as  well  as  to  such 
SaS  stochastic  processes. 

Note  that  the  distribution  of  an  a-sub-Gaussian  vector  is  determined 
by  a and  a positive- definite  matrix  E and  that  the  distribution  of  an 
a-sub-Gaussian  process  is  determined  by  a and  a positive-definite  function 
-l(s,t).  Hence  sub-Gaussian  distributions  have  a particularly  simple  para- 
metric description,  unlike  the  general  SaS  distribution.  However,  it  is 
not  known  how  the  spectral  measure  of  a sub-Gaussian  vector  is  expressed 
in  terms  of  a and  E. 

While  stable  measures  on  a separable  Banach  space  suffice  for  our 
purposes,  we  may  mention  that  [Dudley  and  Kanter  1974J  and  [DeAcosta 
1975]  treat  stable  measures  on  more  general  "measurable  vector  spaces," 
and  [Rajput  1975]  defines  certain  stable  measures  on  topological  vector 


spaces . 
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2.  Independence  . 

The  question  of  how  to  characterize  the  indei^endence  of  jointly  SaS 
randan  variables  is  a natural  one  and  has  been  answered  in  [Schilder 
1970,  Theorem  5.1]  and  in  [Paulauskas  1976,  Proposition  4] . Although 
these  results  by  Schilder  and  Paulauskas  are  stated  correctly , the  proofs 
as  they  appear  are  not  convincing  and  a more  detailed  treatment  seems 
justified.  The  implications  of  independence  are  important  for  us  in 
the  following  chapter  when  we  consider  SaS  processes  having  independent 
increments;  so  in  this  section  we  prove  a characterization  of  independence 
for  jointly  SaS  randan  variables  or  vectors  in  terms  of  the  support  of 
their  spectral  measure. 

1.2.1  THEOREM.  Let  he  jointly  SaS  random  variables  with 

0 < a < 2 and  spectral  measure  r.  For  fixed  k and  m satisfying 

1 < k < m < n,  and  Cjjj  are  independent  if  and  only  if  r({  (Xj, . . . .x^^lfS: 

Vm  * ' "• 

This  result  is  essentially  due  to  Schilder,  but  its  proof  here  is 
based  on  Lemma  1.2.2  which  we  state  and  prove  first.  The  technique  used 
in  the  lemma  was  motivated  by  the  proof  of  Lonma  1 in  [Kanter  1973] . 

cis 

Define  the  o-finite  measure  p on  (0,“)  by  p(ds)  = -j-—  , define 

0:  (0,®)  X ->■  by  0(s,x)  = sx,  and  define  T:  R^  by  T(x^ x^J 

= where  y^  = x^^,  y^  = x^,  and  y^  = 0 if  i k and  i m. 

h’  such  that 
m 

= I (2-cos  h-v.  - cos  h]v.)  > 0 
j=k,m  ^ ^ ^ ^ 


Let  V = FT  ^ and  G = (pxv)0 


Choose  four  real  numbers  h. 


r 


' i 

j. 
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whenever  0 or  ^ 0. 


k 

6 


k 


I.  i 


1.2.2  LEMMA.  The  function  R ->  R defined  by 


Hrj  = / 

uniquely  determines  the  measure  f(v)G(dv)  on  R*^ 


Proof:  Notice  that 


4/(r)  = ! |^r,Tx^|“r(dx)  = / |^r,x^|“v(dx) 
S j^n 


for  all  reR^  and  that  for  all  zeR 


zl*^  / (I'cos  s)p(ds)  = / (,1-cos  zs)p(ds)  . 
0 0 


Thus 


tp(r)  / (1-ccs  s)p(ds)  = / / l^r.x^l^Cl-cos  s)p(ds)v(dx) 


,n  0 


/ (,l‘Cos/r,sx\J  (pxv)  (.dsxdx)  = / (l-cos/r,v\JG(dv) 
(0,<x.)xr"  ^ / r"  ^ ^ 


for  every  rrR^.  Let  = (,. . .0. . . ,hj^, . . .0. . .)  and  6^^  = ( . . .0. . . ,hj^, . . . 
0...J,  where  the  coordinates  h^  and  h^^  are  in  the  k-th  and  m-th  posi- 
tions, respectively.  Then  for  every  reR*^  the  function  ip  determines 

T I / [[l-cos/r+6.,v\)  + (l-cos/r-6. ,v\)  - 2(l-cos/r,v\) ]G(dv) 
^ j=k,m  r"  \ J / \ J / ^ / 

= / cos/r,v\  I (1-cos  h-v.jC(dv) 
r"  ^ ^j=k,m  J 

= / e ' I (1-cos  h.vJG(dv)  , 
r"  j=k,m  J J 

since  G is  a symmetric  measure.  Thus  determines  the  value  of 
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/ e ' f(v)G(.dv3  for  every  reR  . Since  £(v)G(dv)  is  a finite  measure 

r" 

on  R^,  the  result  follows  from  the  uniqueness  of  the  Fourier  transform,  □ 

Proof  of  Theorem  1.2.1:  If  and  ^ are  independent,  then  their  joint 

c.f.  factors.  Thus  for  every  real  rj^  and  r^ 


Consider  the  measure  Fq  on  S placing  mass  j /|xj^|“r(dx)  on  (...0..., 
1,...0...)  and  on  (. . .0. . . ,-l, . . .0, . .) , \diere  the  1 and  -1  are  the  k-th 
coordinates;  placing  mass  -^  / |Xj^|°‘r(dx)  on  (...0...,1,...0...)  and  on 
(...0...,*1,...0...),  where  the  1 and  -1  are  the  m-th  coordinates;  and 
placing  mass  zero  on  the  ranainder  of  S.  Then  clearly 


for  all  r.  , r . Let  Vq  = FqT  ^ and  Gq  = (pxvq)6  Define 

B = {veR^:  v,  v 0}  and  observe  that 
k m 


/ Xg(,v)f(v)GQ(dv3  = / / Xg(sx)f(sx)(pxvp)(dsxdx) 

Rn  0 j^n 

" ^ X{x  X ® ’ 

0 j^n  k m^ 

since  Vg({xeR”:  Xj^x^  ^ 0}J  = TgCixeS;  Xj^x^^  Ml)  = 0.  By  (*)  and  Lemma 
1.2.2,  f(v)G(dv)  and  f(v)GQCdv)  must  agree  on  B.  Hence 

0 = / Xg(vjf(v)G(dvj 


= / / X,„  „ (x)f(sx)v(dx)p(ds3  , 

0 „n 
K 
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so  that  / ^ ^g^(x)£(sQx)v(dx)  = 0 for  some  Sq  > 0.  Because 

j^Ti  Ic  m 

f(sQx)  > 0 on  8^^  ^hat 

0 = v({xeR'^:  Xj^x^^t^O})  = r({xeS:  x^Xj^^O})  . 
Conversely,  f({xeS:  = 0 implies  that 


+ r X TrCcbcj  = 
m m‘ 

f / 

+ / + / . 

/ ■ 

X 

"V 

o 

V"  V" 

V" 

o 

il 

X 

3 

o 

II 

o 

= l-kl^/l 

K cj 

Xkl“r(dx)  , |rj 

l“/|x, 

L 1 A,,  ' 1 ^ 

k k mm 


Thus  Cj^  ajid  are  independent  since  their  joint  c.f.  factors.  □ 

1.2.3  COROLLARY.  A subset  ,...,5j^_}  of  is  independent 

if  and  only  if  the  random  variables  are  pairwise  independent. 

Proof : Necessity  is  clear.  For  the  sufficiency,  T is  concentrated  on 
the  set  {xj^  x^  0,  p q in  l,2,...,i)  and  therefore  we  have 

P q 

/|r,  X,  +...+r,  x.  |°‘r(dx) 


■ ^ IFi  \ ^ ’'f'*-'’ 

{x.  =0}  6c,  =0}  I ^i 

K2  k-  Kj  k..^  j 

= /kn  \ |“r(dx)  + ...+  /|r  x^  |“r(dx)  . □ 

S Kf  Ki  g K.  K. 


1.2.4  COROLLARY.  Let  {k^,...,kj}  and  {m.j^ , . . . ,m^  } be  disjoint  subsets 

of  {!,..., n).  Then  the  random  vectors  (Cv  ,...,5^  ) 

*^1  *^i  1 j 
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ave  independent  if  and  only  if  any  two  random  variables^  one  selected 
from  each  vector,  are  independent. 


Proof : Necessity  is  clear.  For  the  sufficiency,  observe  that 


rir,  X,  +...+r,  X,  +r  x !-,..+r  x |“r(cix) 
^1  kf  k^  m . m ^ ' 


/ 


/ 


^ 1.^ 


2 . ...2  (JZ  ^ r,.2  , ...2  _r,-\  r..2  . ._2 


fx^  +...+Xj^ 

^ and  ^ 

x^  +..,+x^ 

m. 


•I 


X,  + . . . +x,  ^0 
k,  k. 

and 

[x^  +...+x^  =0 
'■  m-  m. 


m. 

1 


^ and  ^ 

x^  +...+x^ 
"'l  "’j 


1 and  1 

2 2 
x^  +...+x^  =0 
m,  m. 

1 1 


r(dx) 


/|r,  x^  +...+r,  X l“r(dx)  + /|r^  x +...+r  x l^^rCdK)  , 

s h\  hh  s "'j  ">j 


since  F{x?  +...+X?  ^ 0 and  x^  +...+x^  ^ 0}  = 0 by  Theorem  1.2.1.  □ 

kl  l^i  "’l  "’j 


1.2.5  Example.  If  S2>?2’  ^3  jointly  SaS  random  variables  with 

0 < a < 2 and  spectral  measure  F,  then  ^3  are  independent  if 

and  only  if  F is  concentrated  on 


{xiXj=0}  U {x2Xj=0}  = (Xj=0}  (J  {X2=0  and  X2=0} 
= {Xj  + X2=l}  U {Xj=±l}  . 

^3 

?K 
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1.2.6 


:.  It  is  easy  to  check  from  their  c.f.  that  two  non- 


degenerate jointly  sub-Gaussian  random  variables  (0  < a < 2)  cannot 
be  independent.  Indeed,  consider  the  bivariate  normal  c.f. 


e^{-2‘^Vl  ^ ^ ’ 


2 2 

where  > 0 and  ^2  > 0 are  the  marginal  variances  and  is  the  co- 
variance.  Then 

_ a a 

<J)(r^,r2)  = exp{-2  + ^°12’'l’'2 

is  the  joint  c.f.  of  two  nondegenerate  sub-Gaussian  random  variables 

that  are  independent  if  and  only  if 

a 

/•22._  2 2.,  2 tti  .a.a.  ,a 

(*)  (a^r^  + 20j2V2  ^ V2^  ^^ll^l'  ^°2l^2i 


for  all  Tj,r2.  The  left-hand  side  of  (*)  is  never  zero  when  r2  0; 
so  we  hold  T2  ^ 0 and  differentiate  both  sides  with  respect  to  r^^  to  get 


'^l’"l  ^12’'2 


_ -.a-1 

2-a  °l‘^’^l^ 


r 2 2 ^ ^ ^2  2.  2 

(Oiri  - 2o^2^^^2  " <^2^2^ 


whenever  r2  ^ 0,  which  becomes 


..a-1  ^ _a_  1^  lU  _ a_  |Ci  a Z,  ^a-i 


a , a 2,  ^a-l 


after  substituting  (*)  and  simplifying.  Taking  r^  = 
we  see  that  •-=  0;  so  we  now  have 


0 and  t2  " 1 


.,2  r .a-1  _ a 2,  ,a-l 
°1°2’^1^’^2^  °1®2^^1^  ^2 


5 ) 


whenever  r2  0,  which  implies  that  Oj^a2  = 0,  a contradiction.  (Note: 
when  raising  a number  u to  a power  p we  shall  use  the  convention 
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(u)^  = |u|^  sign(u)  .) 


3.  Regression. 

In  this  section  we  obtain  a necessary  and  sufficient  condition, 
expressed  in  terms  of  their  spectral  measure,  for  a regression  involving 
SaS  random  variables  to  be  linear  (Theorem  1.3.7).  This  is  a consequence 
of  a result  relating  the  form  of  the  linear  regression  function  to  par- 
tial derivatives  of  the  joint  c.f.  (Theorem  1.3.1).  We  also  obtain 
a sufficient  condition  for  linear  regression  (Proposition  1.3.8)  which 
is  simpler  than  the  necessary  and  sufficient  condition  in  Theorem  1.3.7, 
but  nevertheless  has  some  interesting  applications. 

Let  , . . . be  jointly  SaS  random  variables  with  1 < a < 2. 

For  an  SaS  distribution  on  R it  is  well-known  that  the  moments  of  order 
p < a exist,  and  it  is  therefore  meaningful  to  consider  E(Cq|  • ,Cj^) 
and  to  study  the  form  of  f for  which 

E(^qUj,...,C^)  = f(^p...,^j^)  a.s. 

Ranter  has  obtained  several  results  which  show  that  f is  a linear 
function  in  certain  cases.  The  regression  E(Fp|^P  is  always  linear 
(Corollary  1.3.4), as  is  the  regression  E(Cq| Cj . • • • provided 
are  independent  (Corollary  1.3.6)  ((Ranter  1972a]).  In  case 
E(CoUi* • • • t^n^  and  5^,...,?^  are  jointly  SaS  (a  condition  for  which 
criteria  are  not  known),  then  once  again  the  regression  is  linear 
([Ranter  1972b] ). 

For  our  investigations  we  shall  use  a general  result  giving  a neces- 
sary and  sufficient  condition  for  linear  regression  in  terms  of  the  joint 
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c.f.  of  the  random  variables  (not  necessarily  stable).  The  method  of 
proof  comes  from  a related  result  found  in  [Lukacs  and  Laha  1964, 
Theoron  6.1.1]. 


1.3.1  THEOREM.  Let  be  random  variables  having  first 

moments  and  with  joint  c.f.  <)>.  Then 

(*)  ^ ^l^l'*'"’'^^n^n 

if  and  only  if 

‘f’t’^0’^1 ^n^^rQ=0 


= a^^KO.r^ 

1 n 


for  all  r^, . . . ,r^^. 


Proof : Observe  first  that  the  condition  may  be  written  as 


(**) 


E[5„e  ^ ‘ " " 1 

- ajEUje  l*....a„E|C„e 


for  all  r, , . . . ,r  . 

1 ’ n 


Necessity.  (*)  implies 


i(r,C,+...+r  C ) 

(ai5i^...+an^e  a 


and  (**)  follows  by  taking  expectations. 


Sufficiency.  Let  E(^g-a^?j- . . . -a^C^I  . . . ,Cj^)  = f(^^,...,^J 


where  f is  a Borel -measurable  function  on  R".  Then  for  all  r,,...,r 

1 n 


we  have  that 


i(r.,x  +. . .+r  X ) 

/ f(Xj,. . . ,x^)e  " " (Xj,, 

“ f [f CCj  > • • • >Cj^3 c ] 


.,xj 


i{ri5j*...*rn5n) 


by  (**) . Now 


v(B)  = / f(Xj^,...,x^)dP(C^,...,Cj^)  ■^(Xj,.  ..  ,Xj^) 

B 

defines  a finite  signed  measure  (f.s.m.j  on  R*^  which  is  therefore  unique- 
ly determined  by  its  Fourier  transform.  Thus 


/ f(?j,...,5j^)dP 


= / f(Xj^,. . . ,x^)dPCCj,. . . ,Cj^)'^(Xj^,. . . ,Xj^)  = 0 

B 

for  all  Borel  subsets  B of  R^,  and  since  f CC]^.  • • • »^j^)  is  a 
measurable  random  variable,  we  get  that  f . ,^j^)  = 0 a.s.  [P]  and 
(*)  follows.  □ 


If  the  regression  is  linear,  then  it  is  clear  that  the  coefficients 
ap...,a^  are  uniquely  determined  by  4)  if  and  only  if  are 

linearly  independent  elements  of  Lj^(JI,F,P).  For  each  choice  of  rcR^ 
the  condition  of  Theorem  1.3.1  provides  a linear  equation  involving  the 
a^’s,  but  it  is  not  clear  in  general  what  n choices  of  reR’^  will  provide 
n linearly  independent  equations  which  can  be  solved  for  the  ^j’s. 
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t , 

il 


1.3.2  Example.  If  5o’^l’’"’^n  jointly  a-sub-Caussian  random  var- 
iables, then  the  regression  is  linear  and  the  coefficients  arc  the  same 
as  in  the  Gaussian  case.  For,  let 


♦ = exp|-2  I Oyrir^J")  . 

where  T.  = (o^  J is  a covariance  matrix.  Then  for  r^.-.-.r^^  not  all 


*■  o / n 


2l 


IJ 


zero, 


9<{>(rQ,r^,...,r^) 


9r. 


-g2  ^<^(0,rp....r^)^”^^gQ.r. 


^0=0 


2-a 


(yP  . .0. .r.r.) 

'•^i,j=l  ij  1 j'' 


and  for  1 s k < n 


Scj)  (0 , , . . . , r^J  ~cx2 


9r, 


. -o.  .r.r .) 
^'=■1,3=1  ij  1 


2-a 


Therefore  the  condition  of  Theorem  1.3.1  is  written  as 


n n 


I ^o-r  . = I a,  y 0 , r 
j = l J k=l  j = l J 


or 


= 0 


for  all  r, ,...,r  , and  thus  it  is  satisfied  bv  the  a,  ’s  which  are  the 
I n ' k 

solutions  of  the  system  of  equations 


^Oj’  j " • 


J 
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\ 


Hence  the  regression  is  linear  and  the  regression  coefficients  satisfy 
the  same  equations  = Oq,  a^  = (a^,...,a^),  . . . ,0^^) , as 

when  are  jointly  Gaussian  with  mean  zero  and  covariance 

matrix  E . 


1.3.3  COROLLARY.  If  are  jointly  SaS  with  spectral  measure 

r on  the  un'.-t  sphere  S fn  then 


E(CqUj,  • • . 

if  and  only  if 

/(Wr----Vn><Vi*-"*Vn)°‘'^r(dx)  . 0 

for  all  r^f...i r^ . 

Before  illustrating  the  use  of  Corollary  1.3.3,  we  define  the 
covariation  of  n with  ? as 


where  n and  ? are  jointly  SaS  with  spectral  measure  F . (Note  the 

n > s 

lack  of  symmetry  in  n and  5 here.)  The  next  result  provides  C^_  with 
an  interesting  interpretation. 


1.3.4  COROLLARY.  [Kanter  1972a,  Theorem  1.4].  If  n and  are  jointly 
SaS  random  variables ^ then 

C ^ 

E(nK)  = ^ ^ a.s. 


Proof:  By  Corollarv'  1.3.3,  E(nU)  = ac  a.s.  if  and  only  if 
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/ (x,-ax^)  (rx^J°‘'^r  (dx)  = 

g 1 4 4 ' I > S 

for  all  reR.  Solving  for  a yields 

/ (dx) 

S ^ ^ = V 

/ Iv-  I'^T’  fA^^  ?? 


□ 


For  jointly  Gaussian  random  variables  n and  c with  zero  mean  (the 
case  a = 2)  it  is  well-known  that  a result  analogous  to  Corollar)’  1.3.4 
holds  with  replaced  by  the  covariance  of  n and 

By  appropriate  choice  of  1 it  is  easy  to  see  from  Corollary  1.3.3 
that  the  regression  can  be  nonlinear.  For  example,  take  n = 2 and 
suppose  that 


r(3'^/^3’^/^,3'^/^)  = r(0,i,0)  = r(0,0,i)  = i 

and  that  F places  zero  mass  on  the  remainder  of  S.  (Note  that  F need 
not  be  symmetric  unless  we  are  concerned  about  uniqueness.)  Then 

^ linear  function  of  and  however,  even  in  this 
simple  case  we  do  not  know  the  form  of  the  regression. 


1.3.5  COROLLARY.  If  jointly  SaS  and  if 

~ ^1^1  "**  ^2^2 

then  and  32  satisfy 


(*) 


^l^^ll  ^ ^2^21  " 

^1^12  "■  ^2‘^22  " ^2  ’ 


I 


where  is  the  covariation  of  with  Moreover,  equations  (*) 

uniquely  determine  and  3-2  if  and  only  if  and  ^2  are  linearly 
independent  elements  of 

Proof:  If  the  regression  is  linear,  then  equations  (*)  follow  immediately 

from  the  condition  of  Corollary  1.3.3  by  taking  r^  = 1,  r2  = 0 and 
ri  = 0,  rz  = 1.  These  equations  have  a unique  solution  unless 


‘^ll^ZZ  '^IZ^Zl 


t.  e. , 


/ |xj|“r(dx)/  |xz|“r(dx)  = / Xj(x2)“’^r(dx)/  Xz(Xj^)“  ^r(dx)  , 

s s s s 

which  implies  that  x^  = Xxz  a.e.  [T]  for  some  XeR  by  Holder's  inequality, 
hence  = X^z  C 

If  n > Z and  the  regression  is  linear,  then  the  regression  coeffi- 
cients aj  again  satisfy  linear  equations  given  by  the  condition  in 
Corollary  1.3.3.  Unfortunately,  just  as  in  the  non- stable  case  (Theorem 
1.3.1),  we  do  not  know  in  general  how  to  choose  n linearly  independent 
equations  that  can  be  solved  for  the  aj’s. 

The  following  corollary  shows  that  the  regression  is  always  linear 
and  the  regression  coefficients  are  easily  obtained  whenever 
are  independent. 


1.3.6  COROLLARY.  [Kanter  197Za,  Theorem  3.4].  If 

are  jointly  SaS  random  variables  and  if  are  independent  and 

nondegenerate,  then 

I » • • • a.s.. 
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arui  the  coefficients  a^,  ane  jiven  by 

C 

Ok 


a,  = . 
k I 


kk 


where  is  the  covariation  of  with  and  the  covariation 

of  with  itself. 

The  proof  follows  easily  from  Corollaries  1.2.3  and  1.3.3. 


We  now  obtain  a condition  for  linear  regression  by  applying  to 
Corollary  1.3.3  the  methods  used  in  Lorana  1.2.2.  Although  the  resulting 
condition  appears  surprisingly  involved,  it  is  not  clear  that  further 
simplification  is  possible. 

Define!:  by  Ify^.y^ , . . . .y^^)  = (O.y^ , . . . ,y^) , define 

6:  (,0,'»3  X S -*■  R^^^  by  0(s,x)  = sx,  and  define  the  o-finite  measure  p 
on  (0,«>3  by  p(ds)  = ds/s°^.  Let  f(x)  = Xq  - a^^Xj- . . . -a^x^,  and  define 
a f.s.m.  V on  S by  v(dx)  = f(x)r(dxj.  Let  G be  the  measure  on  R^^^ 
defined  by  G = (pxv30  and  let  G be  the  a-field  of  subsets 

{RxB:  B is  a Borel  subset  of  R^  -(0,...,0)} 
of  Rx[R^  -(0,...,0)]. 


1.3.7  THEOREM,  Let  ^o’^l’‘‘‘’^n  jointly  SaS  variables,  1 < cx  < 2, 
with  corresponding  measure  F on  S.  Then  E(Cq | , • • • 
a.s.  if  and  only  if  G is  the  zero  measure  on  G. 

Proof:  Assime  that  , • • • a.s.  Then  by 

Corollary  1.3.3, 

/ f(x)(^r,Tx^)'"'^F(dx)  = 0 
for  all  reR^^^.  Note  that  for  any  ztR, 


sin  s p(ds)  = / sin(zs)p(ds) 
0 0 


0 = / £(x)(<r,Tx>)“‘-^r(dx)  / sin  s p(ds) 
S 0 

oo 

= / / sin<r,T(sx)>v(dx)p(ds) 

0 S 

= f sin<r,Tv>G(dv) 


= f sin<r,v>GT  ^(dv) 

Rn+1 


for  all 


Let  be  any  real  numbers,  and  let  6^^  - (0,h^,0, . . . ,0) , 

62  = (0,0,h2,0,...,0) 6^  = (0,...,0,hj^).  Then  for  every  reR^^ 

n -1 

0 = — J [2  sin<r,v>  - sin<r+6  ■ ,v>  - sin<r-6 . ,v>]GT  (dv) 

j-l 

^ -1 

= / sin<r,v>  I (1-cos  h.v.)GT  (dv)  . 


We  can  choose  and  h| such  that  either  ^"^^(1-cos  h^v.) 

X 

or  5|j_^(l-cos  hjVj)  is  nonzero  for  every  ve{  (Vp,Vp  . . . ,v^)eR  : 

Vj+...+v^  > 0}  . Let  g(v)  = ^"^j(2-cos  h^v.  - cos  hjv^).  Then  for 

r,n+l 

every  reR  , 

/ sin<r,v>g(v)GT  ^(dv)  = 0 . 

Rn^l 

Now  it  is  easy  to  sec  that  g(v)GT  ^(dv)  defines  a l.s.m.  on  whicFi  is 

antisynmctric  in  the  sense  that 


J 
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/ g(v)CT'Vdv)  = - / gCvJCT'\dv3 
-B  B 

for  every  Borel  subset  B of  Thus  for  every  reR^^^, 

I e^^’'’'^^g(v)GT  ^(dv)  = 0.  It  follows  by  the  uniqueness  of  the  Fourier 

Rml 

transform  that  g(v)GT  ^(dv)  is  the  zero  measure  on  Hence  GT  ^ 

is  the  zero  measure  on  {(Vq,v^^,  . . . ,v^)eR^^^:  ^ for 

ever>"  Borel  set  B c R^  - (0,...,0), 

G(RxB)  = CT'^(RxB)  = 0 . 

Therefore  G is  the  zero  measure  on  G. 

For  the  converse,  note  that  sin<r,Tv>  is  a G-measurable  function  on 
Rx[r'^  - (0,...,0)]  for  every  reR^^^.  Thus,  if  G is  the  zero  measure  on  G, 
then 

/ sin<r,Tv>G(dv)  = 0 

for  every  reR"^^^.  The  linearity  of  the  regression  now  follows  from  ctiua- 
tion  (*)  and  Corollary  1.3.3.  n 

The  condition  in  Theorem  1.3.7  is  too  complicated  for  easy  verifica- 
tion; so  ;ve  shall  present  in  the  following  proposition  a simpler  sufficient 
condition  that  provides  nontrivial  examples  in  which  the  regression  is 
linear.  To  simplify  the  presentation  and  to  make  geometric  visualization 
possible,  we  shall  treat  the  case  n = 2,  f.e.,  the  regression  E(^q1  . 

Therefore,  consider  jointly  SaS  random  variables  with 

1 < a < 2 and  spectral  measure  F on  the  unit  sphere  S = { (Xq,Xj ,X2)cR^: 
Xp+x^+x^  = 1}.  Geometrically,  we  regard  S as  being  separated  into  two 
hemispheres  and  S by  the  plane  {Xq=0} and  obtain  from  the  spectra] 
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measure  r two  new  measures  and  F2  on  the  plane  {Xq  = 0}  by  "collapsing” 
these  two  hanispheres.  Specifically,  let  = Sn{xp>0,  x^;^!}, 

S'  = Sn{x^<0,x^^-1),  and  U = {xeR^:  x^+x^^D,  and  define  T:  S ->  U by 
T(Xq,Xj,X2)  = (x^fX^).  Then,  for  all  Borel  subsets  B of  U, 

Fj(B)  = F(S^nT'^B) 

and  -1 

F2(B)  = r(S  nT  ^B) 

define  two  measures  on  U which  we  notice  place  zero  mass  on  the  point 
(0,0).  Finally,  we  introduce  two  functions  fj  and  f2  on  U representing 
the  function  Xq  - a^x^  - 22X2  on  S and  S , respectively: 

fj(Xj,X2)  = ■ ^l'^2  " ^1^1  ' ^2^2 
^2*-^l’^2^  = - ^1  - Xj-X2  - a^Xj  - 32X2  , 

and  we  define  a f.s.m.  on  Li  by 

v(dx)  = f^Cx)r^(dx)  + f2(x)F2(dx)  . 

1.3.8  PROPOSITION.  If  V is  the  zero  measure  on  U,  then  E(^q|C2^>C2^  “ 
ai^i  + 32^2  a.  a. 

Proof:  The  result  follows  from  Corollary  1.3.3  and  the  following  equality: 

/ (rjX^+r2X2)“‘'^(Xp-ajXj-a2X2)r(dx) 

= / (rjXj+r2X2)'"'^fj(Tx)r(dx)  + / (rjXj+r2X,)“'^f2(Tx) F(dx) 

s'"  “ s' 


/ (rj^x^+r2X2)“'^fj^(x)rj^(dx)  + / (r^Xj+r2X2)“'^f2Cx) r2(dx) 


/ (rjX^+r2X2)“'^v(dx) 


If  Pj  and  f2  are  absolutely  continuous  with  respect  to  a measure  y 
y = + P2)  with  Radon-Nikodym  derivatives  and  g2>  respectively, 

then  the  condition  of  Proposition  1.3.6  can  be  expressed  as 


0 = v(B)  = /[fj(x)gj(x)  + f2(x)g2(x)]y(dx) 
B 

for  all  Borel  subsets  B of  ii,  or  equivalently, 


/|fj(x)gjCx)  + f2(x)g2(x) jy(dx)  = 0 


1.3.9 
of  U by 


;.  Given  real  numbers  a^^  and  a2,  define  a Borel  subset  B 


B = { (Xj,X2)eU:  Vl-x^-X2  - a^Xj^-a2X2  >0  ai 

- Vl-Xj-xl  - aj^Xj  - a2X2  > 0} 

and  two  functions  gj  and  g2  on  U by 


gj(x) 


h 22 

(1-X1-X2  - ajXj  - a2X2 


if  xeB  , 


otherwise  , 


g2(x) 


1 

= ■ Vl  -Xj-x^  + a^Xj  + 


if  XeB  , 


Ld 


0 


otherwise  , 
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and  let  u be  any  o- finite  measure  on  U with  respect  to  which  gj  and 
are  integrable.  Then  (*)  is  satisfied,  and  consequently  E(^p|^^,C2)  = 


^1^1  ^2^2 


There  appears  to  be  little  more  that  can  be  said  about  the  form  of 
the  regression  function  using  the  techniques  of  this  section,  primarily 
because  higher  moments  of  SaS  variables  do  not  exist  (see  the  next 
section) . One  quite  restricted  kind  of  problem  which  can  be  solved 
simply  is  to  obtain  necessary  and  sufficient  conditions  for 
I ^3*^4)  = C3C4  a-s.  when  the  appropriate  moments  exist. 

1.3.10  PROPOSITION.  Let  jointly  SaS  random  variables 

with  1 < a < 2 and  spectral  measure  F such  that  Cj  and  ^2  independent 

and  ^2  <^nd  ^4  are  independent.  Assume  that  0 and  0,  and  for 

each  i,i€il,2,3,4}  let  c. . be  the  covariation  of  L.  with  Then 

ij  •'  1 j 

= ?3^4  a.s.  if  and  only  if  either  CjjC24  = and 

^14  "^^23"^  ‘^14*^23  " ^33*^44  *^13"‘^24  " 

We  renark  that  our  analysis  shows  it  impossible  to  have  a first- 
order  term  such  as  c^^  in  the  above  regression. 

Proof:  In  a manner  similar  to  the  argument  in  Theorem  1.3.1,  it  follows 

that  (^1^21^3, ^^4^  "^3^4 


3 ()>(rpr2,rj,r4) 
^^2 


3‘^(J)(0,0,r2,r^) 


|ri=r2=0 


3r33r4 


for  all  (r^,r4)» where  is  the  joint  c.f.  of  Ej >C2*^3*54*  Obtaining 


; 


the  partial  derivatives,  this  condition  becanes 


^33^^44 

= (’'3^4^  ^^13^^24  *-’^3’^4^  ^14*^23  '*'  ^ 


13'-23 


I |2(a-l) 

' 4I  ^14^24 

for  all  (r^,r^).  Taking  alternately  (r^.r^)  = (1,0)  and  (r^,r^)  = 

(0,1)  we  get  = 0 = and  our  condition  then  becomes 

‘^33^^44  " '^13^24  ^14*^23  ‘ 

But  one  of  the  terms  on  the  right-hand  side  must  be  zero  since  Cj^jC2j  = 0 
= Cj^C2^,  and  both  terms  cannot  be  zero  since  ^3  0 and  0 imply 

0 and  c^^  ^ 0.  0 

1.3.11.  Example . To  illustrate  Proposition  1.3.10  consider  a measure  r 
which  concentrates  its  mass  as  follows:  mass  ^ is  placed  on  the 

four  points  (0,2'^/^,2'^'^^,0) , (0,2'^^^,-2'^^^,0) , (2'^/^,0,0,2‘^^^) , 

(2  ^^^,0,0, -2  ^^^) ; and  mass  is  placed  on  the  two  points 

((5)^^^0,(i)^/^0),  (0,(i)^/^0,(i)^/^).  Then  0^3  = c,^  = C33  = c^4  = 2 
and  C44  = C23  = 0,  and  therefore  ^(^^^2 1 53^4)  = ^3^4  a-s.  (Notice  that 
neither  and  ^4  nor  E,j  and  ^3  are  independent.) 

We  conclude  this  section  with  a discussion  of  regression  in  the 
infinite-dimensional  case.  The  reading  of  these  reanarks  might  be  deferred 
since  some  of  the  concepts  which  arise  here  are  dealt  with  extensively 
in  Chapter  II. 

Sujijwse  that  (n,^4.teT}  is  a SaS  family  of  random  variables  with 
I < ot  < 2,  and  consider  the  regression  of  n on  {^^,teT}.  There  exists 


29 


a countable  subset  T of  T such  that 

oo 

ECnU^.te:!)  = E(n|f^,t.TJ  . 

If  we  order  the  points  in  and  let  be  the  set  containing  the  first 
n points,  then 


E(n|C,teTJ  = lijTi  EfnlC.tcT  ) 

n-Hx, 

by  [Doob  1953,  p,  319],  where  the  convergence  is  in  Lp(Sl) , 1 < p < a. 

If  E(n I »teTj^)  e for  every  n,  where  is  the  linear  space  of 

{C^jtcTj^},  then  ECnK^-.teT^)  will  belong  to  the  linear  space  of 

{5^,teT^}  and  consequently  the  regression  E(n|E^.tcT)  will  be  linear. 

We  have  seen  two  cases  where  the  regressions  E(n|5^ .tcT^^)  are  always 

linear:  when  the  process  is  (1)  a-sub-Gaussian  (I'.xample  1.3.2)  and 

(2)  independent  (Corollary  1.3.6).  Case  (2)  is  interesting  when 

{C^.teT}  is  a SaS  process  with  independent  increments,  T = [O,”),  and 

Cq  “ 0.  For  then  o(C^  > • • • ^ ~ ^(^^  ”^t  * * * * ~^t  ^ ^ 

1 n 1 '2  '■1  n n-1 

0 s tj<...<tj^,  and  therefore 

E(r,l5  ) - ajC  * -?  )*.. ■{,  ) a.a. 

In  1 2 1 n n-1 

In  both  cases  (1)  and  (2)  we  have  expressions  for  the  regression  coeffic- 
ients 3j  and  can  therefore  write  E(nK^,t€T)  as  the  limit  of  a sequence 

of  finite  linear  combinations  of  elements  in  {C^,teT}.  We  shall  further 

\ 

investigate  case  (2)  in  Section  3 of  the  following  chapter. 
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4.  Ntoments . 

It  is  known  that  if  C is  an  SaS  random  variable  and  p > 0,  then 
E|C|^  < oo  if  and  only  if  0 < p < a.  We  consider  here  the  question  of 
determining  the  values  of  positive  constants  Pj , • . . ,Pj^  such  that 

(*)  < «> 

when  are  jointly  SaS  random  variables.  Clearly  if  they  are 

independent  the  necessary  and  sufficient  condition  is  0 < p^  < a, 
i = l,...,n.  If  n = 2 and  Ej  and  ^2  dependent,  we  show  that  (*) 
is  equivalent  to  0 < P]^‘*'P2  ^ (Corollary  1.4.5).  For  general  n the 
necessary  and  sufficient  condition  on  the  p^’s  is  the  same, 

0 < pj+. . .+Pj^  < a 

provided  the  SaS  distribution  in  satisfies  a condition  which  we  shall 
call  n-fold  dependence  (Theorem  1.4.4). 

Jointly  SaS  random  variables  with  spectral  measure  P 

are  called  n-fold  dependent  if 

r{xeS:  Xj^. . .x^  ^ 0}  > 0 . 

This  condition  will  often  be  satisfied  and  in  fact  fails. to  hold  only 
when  r is  supported  by  a rather  particular  region  of  S having  (n-1)- 
dimensional  Lebesgue  measure  zero.  It  is  clear  from  Theorem  1.2.1  that 
2- fold  de])endencc  is  etjuivalent  to  dependence,  but  that  for  n > 5, 
n-fold  dependence  is  stronger  than  dependence  (t.c.  , non- independence) . 

In  Leimia  1.4.3  we  prove  an  interesting  characterization  of  n-fold 
dependence . 

We  shall  begin  with  a result  that  gives  a condition  for  the  existence 
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of  moments  in  terms  of  the  c.f.,  which  is  assumed  only  to  be  real -valued 
and  not  necessarily  SaS.  This  theorem  extends  a special  case  of  Theorem 
2 of  [Vtolfe  1973]  to  a multivariate  distribution  and  is  proved  by  like- 
wise extending  the  method  of  Wolfe's  proof. 

1.4.1  THEOREM.  Let  5^,...,^  be  random  variables  uith  real-valued  joint 

Pi  P 

a.f.  and  suppose  that  0 < pj^  < 2 for  k=l,...,n.  Then  EC|Cj|  •’•1^1 
< °°  if  and  only  if 

/^{2'"'^[1  - I (J)(...0...,2z,  ....0...)] 


0 0 


n 7 

+ 2 I 4>(...0...,2z.,...0...,C-1)  ^2z,  ,...0...) 


c^e{0,l} 


4>(2z^,(-1)  ^2z2 (-l)^'''^2Zj^)} 


c , . . . >c^_ 2^  e{0,l) 


dz.dz-  ...  dz 
12  n 

l*p  1*P2 
Z 1 “ o • • • 

12  n 


for  some  e > 0. 

Proof;  We  shall  use  the  following  elanentary  trigonometric  identity: 

-2n-l  .2  .2  .2 

2 sin  z,  sin  z_...sin  z 
12  n 

= 2"'^[1  - I cos  2z,  ] + 2^''^  I cosC2z.  + (-l)^^2z,  ) 
k=l  j<k  ^ ^ 

Cje{0,l} 

c c 

- 2"'^  I cos(2z,  +(-l)  ^2z,  M-1)  ^2zJ 


i<j<k 

C2^»C2€{0>1} 


+...+(-1)' 


c c 

I cosC2z,  + (-l)  ^2z/...  + (-l)  "'^2z„)  . 

r/\  ^ i.  4 11 


> • . • 2^^  {0 > 1 } 
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Necessity.  The  integral  (*)  is  less  than  or  equal  to 

->  1 Pi  p °°  9 ^Ti  “ 9 

2 " /|ril  ••■|rnl  . ,r„)/  sin^i  .../  sinV„ 

R"  0 yj  1 “ y„  " 

Pi  p 

which  is  finite  if  / |r^(  ...|r^|  . . . ,r^)  < °°.  0 


If  the  condition  of  the  theorem  holds  and  if  we  let  e increase  to 

infinity,  then  the  integral  (*)  converges  to 

11  Pi  P “ T ^Yi  °°  1 dy 

-)/  sinV,  •••  / ^n  -T^  ’ 

yi  >n 

Pi  Pn 

and  we  therefore  get  an  expression  for  terms  of  the 

C.f.  <}), 

For  the  analysis  that  follows  we  shall  transform  the  rectangular 
coordinate  system  used  in  (*)  to  another  coordinate  system  in  that  is 
the  familiar  spherical  coordinate  system  if  n = 3.  The  details  of  this 
transformation  are  indicated  in  the  following  lemma. 


1.4.2  LEMMA.  Condition  (*)  of  Theorem  1.4.1  can  be  expressed  as 
mil  mil  z _ 1 r>  1 r' 

/ •••/  / {2"'  - ^ 4.(...0...,2rr,  C0),...O...) 

000  k=l 

+ 2"'^  I <J.C...O...,2rr.C0),...O...,(-l)'^^2rr,  (0),...O...) 
j<k  J ^ 

Cj€{0,l} 


({.(Zrrj^Cel , (-1)  ^2rr2(e) , . . . , 


Cj,...,Cj^_j  £{0,1} 


(-1}  "’^Zrrj^Ce})} 


de^de.,  . . . de  , 
12  n-l 
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for  same  e > 0^  where  0 = (^^2  > • • • ^ 

n-1  n-1 

r,  (9)  = n sin  G,,  r^CO)  = cos  f),  n sin  0,  , 

^ k=l  ^ ^ \=2 

n-1 

rj(0)  = cos  02  n sin  0j^, . • . ,r^(0)  = cos  . 

Proof:  Transform  the  region  of  integration  of  integral  (*)  as  follows: 

Zi  = rr, (0),  Zt  = rr~(0),...,z  = rr  (0).  The  Jacobian  of  this  trans- 

1 1^'^’Z  2 n n 

formation  is  r^  ^n^_2sin^  ^0^.,  and  the  lemma  follows  by  straightforward 
substitution.  0 

The  next  lenma  characterizes  n-fold  dependence  and  has  an  interesting 
interpretation  for  bivariate  SaS  distributions. 


1.4.3  LEMMA.  Let  T be  a finite  syrmetria  measure  on  the  Borel  subsets 
of  the  unit  sphere  S in  and  suppose  that  0 < a < 2.  Then 
r{xeS:  x^...x^  ^ Q]  > Q if  and  only  if 


,n-l 


I /|x^r,  i“rCdx)  - I /|x.r.  + C-l)  \r  |^(dx) 

:=1  S ^ j<k  S ^ ^ ^ ^ 

Cj£{0,l} 


'1..  „ I Ur 


(**) 


2’^'^  I /l^i^.+C-l)  ^x.r.  + (-l)  ^x.r,  |°‘r(dx) 
i<j<k  S ^ ^ ^ 

Cj^jC2£{0,1} 


C > • • . > C^ _je{0»lj  S 

+ ...  + (-l)''"'^r^x^|"r(dx) 

> 0 


for  all  ahoices  of  rj^,...,r^  suah  that  r^...r^  f 0. 


Proof : Similarly  to  what  has  been  done  before,  define  the  a-finite  meas- 

j§^,  define  0:  (0,®)  >•  S by 


ure  p on  (0  ) by  p(ds)  = 
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r 


0(s,x)  = and  let  G = (pxr)6  . Multiplying  the  left-hand  side 

of  inequality  (**)  by  J°°(l-cos  s)p(ds),  we  obtain 

0 


/ {2^'^  I [1-cos  r,v,  ] - 2^'^  I 


,n  k=l 


j<k 

c^e{0,l} 


[l-cos(r^Vj+C-l) 


c c 

+ 2^  ^ I [l-cosCr.v.  + (-l)  ^r-v.  + (-l)  ^r,v,)] 
i<j<k  ^ ^ J J ^ ^ 


{0  > 1 } 


+...+C-1) 


> • • • 1 } 


ll-cosCv^.C-D'^r^v/- "‘V„»lGWv) 


n 1 

= 2 ■ / {1  - I cos  r,  V,  + I cos  r.v.  cos  r,v 

n V=1  J J ^ ^ 


j^n  k=l  j<k 


I cos  r.v.  cos  r.v.  cos  r,v, 
i<j<k  ^ ^ ^ ^ ^ ^ 

n 

+ ...  + C'l)^  n cos  r,v,  }G(dv) 
k=l 

= 2^  (1-cos  rj^v^)  (1-cos  r2V2) ...  (1-cos  rj^v^)G(dv) 


= 2^  j j (1-cos  r,sx, )... (1-cos  r sx  )p(ds)r(dx) 
SO 


= 2 J f (1-cos  r,sx^) ...  (1-cos  r^^sx  )p(ds)r(dx)  , 

{xeS:Xj. . .x^^O}  0 

for  all  choices  of  r,,...,r  such  that  r,...r  0. 
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It  is  then  clear  that  (**)  implies  that  r{xeS:  x^...x^  0}  > 0. 

Conversely,  for  every  xcS  such  that  Xj^...x^  ^ 0 and  every  rfR^  such  that 


I 


I 

f 


( 

\ 

t 


3() 

00 

/(1-cos  r, sx, )... (1-cos  r sx  )p(ds)  > 0 , 

0 " 

so  that  r{xeS:  x^,..x^  ^ 0}  > 0 clearly  implies  (**) . □ 

It  should  be  pointed  out  that  the  condition  of  Lemma  1.4.3  is 

not  changed  if  we  require  inequality  (**)  to  hold  for  only  one  choice 

of  r, ,...,r  such  that  r, ...r  ^0,  and  it  is  also  clear  that  the  direc- 

1 n In 

tion  of  inequality  (**)  is  never  reversed. 

If  we  take  n = 2 and  r^  = r2  = 1,  then  Lemma  1.4.3  yields  the 
following:  r{xeS:  Xj^X2  0}  = 0 if  and  only  if 

/ |x^+X2|“r(dx)  + / (x^-X2(“r(dx) 

s s 

= 2 / lx.,  l“r(dx]  + 2 J lxJ“r(dx)  . 

s s 

If  and  ^2  jointly  SoS  random  variables  with  1 < a < 2 and  spectral 
measure  F,  this  latter  condition  may  be  written  in  terms  of  a norm  intro- 
duced in  the  next  chapter: 

lUi^zir  11^-^211“  = 2115^11“  + 211^211''  » 

which  is  analogous  to  the  parallelogram  law  for  an  inner  product  space. 
Indeed,  if  a = 2 the  equation  is  precisely  the  parallelogram  law  stated 
for  two  zero  mean  bivariate  normal  random  variables,  but  if  1 < a < 2 
we  get  t’liat  the  "parallelogram  law"  holds  for  two  bivariate  SoS  random 


variables  if  and  only  if  they  arc  independent  (Theorem  1.2.1). 
We  now  apply  Theorem  1.4.1  to  ScxS  random  variables. 
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1.4.4  THEOREM.  Let  ^^,...,5^  be  n-fold  dependent  .jointly  ScxS  random 

variables  with  spectral  measure  F and  0 < a < 2.  Then  for  positive 

Pi 

numbers  , . . . we  have  E(  | | if  and  only  if 

Pl+---+Pn  < a. 


Proof : Combining  Theorem  1.4.1  and  Lemma  1.4.2  and  using  the  particular 

Pi  P 

form  of  the  c.f.  ip,  we  have  that  E(|Cj^|  ...  |^  | ’^  < “ if  and  only  if 


I I (2^  ^ - 2^  ^ [ exp[-2“r“/  |rj^(e)xj^|“r(dx) ] 

k=l  ^ K K 


0 


0 0 


^2^'^  I exp[-2“r'"/  lr.(0)x.  + (-l)  \(0)x  |“r(dx)]+... 
j <k  S ^ J K K 

Cj^e{0,l} 

+ (-!)"  I exp[-2V/  |rj(0)x^+(-l)%2^®^''2  ■"••• 

j . . . { 0 , 1 } S 


+C-1)  '"■^r^(0)x^l«r(dx)]} 

dr  d0^  d02  ...  de^.^ 


l+Pl+.-.%  n-1 


1+iLiPi  ^■"Pk+i 

n[(sin0)  J^^Ccosej 
k=l  ^ ^ 


< OO 


for  some  e > 0.  It  is  apparent  from  inspection  of  the  development  of  this 
integral  in  Theorem  1.4.1  that  the  only  region  where  convergence  to  a 
finite  limit  is  in  question  is  for  points  where  r is  small.  At  r = 0 
the  factor  of  the  integrand  in  braces  reduces  to 


2n-l  _ + 2'^’^(2)2  - 2’^'^C3)2^+.  . .+  (-l)"2’^‘^ 

^ 2"'^[1  - (J)  + (")  - C3)  +...+(-1)"] 

= 2"'^(1-1)"  = 0 . 
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We  now  differentiate  this  factor  in  braces  to  assess  the  rate  of 
convergence  to  zero  as  r *■  0.  The  resulting  partial  derivative  with 
respect  to  r is 


^2CXra-l[.2n-l  ^ /|rj^(0)xj^|“r(dx)(K. . .0. . . ,2rrj^(6) , . . .0. . 

Ic""  1 S 

^ 2^'^  I {/|r.(0)x.^(-l)%,Ce)x  I“r(dx) 
j<k  S J J K K 


C^e{0,l} 


())(.,  .0. . . ,2rr^  (0) , . . .0. . . , C-1)  ^2rrj^(0) . .0. . .) } 


+(-!)"  I {/|rj(e)Xj+(-l)  ^r2C0)x2+... 

Cj^ » . . . jC^_2^g{0 , 1 } S 

c c c 

+ (-l)  "■^rj^(0)x^|“r(dx)(},(2rrjC0),C-l)  ^2rr2Ce) , • • • , C-1)  '^■^2rrj^(0)) }] 

a-1 

From  the  common  factor  r in  this  derivative  it  is  evident  that  the 
factor  of  the  integrand  in  braces  is  of  order  OCr*^)  as  r ->•  0.  But  it 
is  possible  that  the  convergence  to  zero  with  r is  even  faster  if  the 
other  factor  in  the  derivative  converges  to  zero  as  r 0.  However,  at 
r = 0 this  other  factor  in  brackets  is 

-2"'^  I /|r.  (e)x,  l“r(dx)  + 2"'"  I /|r  co)x.+  (-i)''\Ce)x,  l^^rCdx) 
k=l  S ^ j<k  S ^ J ^ 

CjeCO.l} 

n 

-...+(-1)  I j r (0)x  +(-l)  V,(0)x^+... 

c,,...,c  cCo.llS 
1 n- 1 


+ (-n  "■V^f0)x^rr(dxi  , 


Tisn-l 


is  nonzero  for  all  0 = (0, , . . . ,0  , )e (0,— ) by  Lemma  1.4.3  since 

i II  A ^ 
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the  functional  values  ^re  nonzero  for  such  6 (Lemma  1.4.2), 

It  is  clear  from  Fubini's  theorem  that  if  the  integral  is  finite 


then  the  factor  of  the  integrand  in  braces  is  integrable  over  (0,c)  with 

l+p,+...+p 

respect  to  the  measure  dr/r  . Since  this  factor  of  the  inte- 


grand is  of  order  OCr*^)  and  of  no  smaller  order  as  r -»■  0,  if  the  integral 
is  finite  then  pj+...+Pj^  < a. 

The  sufficiency  of  the  condition  pj+..,+p^  < a is  clear,  since 


Pt+. . .+p 

s [E(|e,|  ^ ")i 


[ECltnl  ^ ")1 


by  Holder's  inequality. 


The  following  corollary  was  conjectured  by  Holger  Rootzdn  and  is 
an  immediate  consequence  cf  Theorem  1.4.4  for  the  case  n = 2 and  Theorem 

1.2.1. 

1.4,5  COROLL'Ry.  Let  CL^d  Co  dependent  Jointly  SaS  random  variables, 

Pt  P-j 

0 < a < 2,  and  let  p^  > 0 and  P2  > 0 foe  given.  Then  ( | Cj  I 
if  and  only  if  Pj  P2  ^ 


In  Theorem  1.4.1  and  the  succeeding  remark  we  have  seen  how  to  com- 
pute the  absolute  moments  of  monomials  in  when  their  joint  c.f. 

4>  is  real-valued.  We  shall  conclude  this  section  with  an  expression  for 
Pi  ?2 

(C2)  ] terms  of  4)  when  the  corresponding  absolute  moment  is 

finite.  Such  moments  will  be  of  interest  in  the  next  chapter  for  random 
variables  and  ^2  having  finite  absolute  moments  of  order  p,  1 < p < 2, 


a: 


1.4.6  THEOREM.  Let  cmd  be  random  variables  with  real-valued  .joint 

Pi  Pt 

a.f.  <{)  such  that  IC2I  ) ”3  where  0 < < 2 and  0 < P2  ''  2, 

. 3 dv 

and  when  0 < p < 2 let  c(p)  = 2/  sin  y . Then 

0 y ‘ 

= 32c(p))c(p2)i  i ■ 9d,(Zj,Z2) 

+ 4)(3Zj^,-3z2)  - (|)(3Zj^,3z2)  - 3(J)(Zj,-3z2) 

dZi  dz2 

+ 3(|) (z^ , 3Z2)  ■ 34’(5Zj»"Z2)  ■*■  ^4* (3zj^ j Z2) ] T^p  i+p 

(Zj)  ^(Z2)  ^ 

Proof:  As  in  Theorem  1.4.1  the  proof  is  based  on  an  elementary  trig- 

onometric identity: 

3 3 

32  sin  Zj^  sin  Z2 

= 9 cos(Zj^-Z2)  - 9 cos(z^+Z2)  + cos (3z^^ -3Z2)  - cos(3z^+3z2') 

- 3 cos(z^-3z2)  + 3 cos(z-|^+3z2)  - 3 cos(3z^-Z2)  + 3 cos(3z^+Z2)- 

2 

If  p is  the  measure  induced  on  R by  (C^3^2^» 

c € 

I j [9(})(z^,-Z2)  - 90(Zj,Z2)  + 4)(3z^,-3z2)  - f(3z^,3z2) 

-c  -e 

dZj  dz, 

- 3(})CZj,-3z2)  + 3<})CZj,3z2)  - 3^>(3Zj,-Z2)  + 34.(32j,Z2)l — j 

(Zj)  hz,) 

cc  J dz^dz.^ 

= 32  / / / sin'^r,z,  sin'^r7Z2dM(r  j ,r2)  ^ 


Jf 
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II.  A FUNCTION  SPACE  APPROACH  TO  SaS  PROCESSES 

It  is  a customary  method  in  the  study  of  second  order  stochastic 
processes  to  establish  an  isomorphism  between  (a  subspace  of)  the  linear 
space  of  a process  and  a Hilbert  space  of  functions  and  to  translate 
problems  formulated  in  terms  of  the  process  into  problems  in  the  more 
familiar  function  space.  In  this  chapter  we  investigate  an  analogous 
approach  to  the  study  of  p-th  order  processes  by  seeking  an  appropriate 
Banach  space  of  functions  that  is  isometric  to  (a  subspace  of)  the  linear 
space  of  a p-th  order  process  (Section  2).  Ivhcn  applied  to  a SaS  process 
with  independent  increments  (Section  3),  our  results  yield  the  stochastic 
integral  defined  in  [Schilder  1970J , and  when  applied  to  an  "absolutely 
continuous"  process  (Section  5),  they  yield  a stochastic  integral  of 
more  specific  form  which  can  be  also  regarded  as  a siimple  path  integral. 

We  conclude  the  chapter  by  exploring  the  possibility  of  using  the  statis- 
tical properties  of  the  output  process  to  identify  a linear  system  with 
a known  SxS  input  (Section  7). 

1 . The  linear  space  of  a process. 

After  defining  the  linear  space  of  a p-th  order  process  and  the  linear 
space  of  a SuS  process,  w'e  show  that  the  duals  of  ixith  spaces  have  a kind 
of  Riesz  representation  (Theorem  2.1.5)  and  that  the  two  spaces  coincide 
in  the  case  of  a S(xS  process  (Proposition  2.1.2).  These  results  arc 
essential  to  our  later  development  of  stochastic  integrals  with  respect  to 
.Sa.S  processes. 
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Let  ={C^»teTi  be  a stochastic  process  with  underlying  probability 
space  (fl,F,P).  If  C^eLp(fl)  for  all  tcT  where  0 < p < “,  then  we  call  C 
a p'th  order  process.  Unless  otherwise  specified,  throughout  this 
chapter  we  make  the  restrictions  1 < p < «>  for  p-th  order  processes  and 
1 < a < 2 for  SaS  processes. 

Let  Jl(C)  be  the  space  of  all  finite  linear  combinations  of  elements 
of  {^^,t€T}.  If  5 is  a p-th  order  process,  then  define  a norm  on  £(C) 

by 

Ikll  = 

for  all  If  C is  a SaS  process,  then  for  every  ^eZ(i)  it  follows 

irC 

from  result  1.1.2  that  there  exists  some  b > 0 such  that  E(e  ) = 


-b^|r| 


for  all  reR.  Then 


Ikll  = bJ/“ 

defines  a norm  on  ([Schilder  1970,  Corollary  2.1]).  It  is  a con- 

sequence of  the  continuity  theorem  for  characteristic  functions  that 
convergence  with  respect  to  this  norm  is  equivalent  to  convergence  in 
probability.  For  a p-th  order  or  a SaS  process  E,  wc  let  L(C)  denote 
the  completion  of  ?.(E)  with  respect  to  its  norm.  If  E is  SaS,  we  shall 
show  that  L(E)  is  a S(xS  family  by  using  characterization  1.1.3  of  the 
SaS  c.f.  due  to  Kuelbs. 


2.1.1  PROPOSITION . If  ^ is  a SaS  proaess,  then  L(E)  is  a family  of 
jointly  SaS  random  variables. 
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Then  is  Cauchy  in  probability  and  hence  converges  in  probability 

to  some  real-valued  random  variable  It  follows  that  the  sequence 

of  random  vectors  { } converges  in  probability  to 

• For  each  n let  be  a homogeneous  negative-definite 
function  of  order  a on  such  that  exp{-A^(y)}  is  the  joint  c.f.  of 
, . . . . By  the  continuity  theorem  for  c.f.'s, 


A“(y)  A“(y) 


for  all  yeR*^,  where  exp{-A“(y)}  is  the  joint  c.f.  of  • 

It  is  easy  to  verify  that  A is  a homogeneous  negative-definite  function 

k 

of  order  a which  is  continuous  on  R , and  the  result  follows  from  1.1.3. 


Clearly  we  may  regard  a SaS  process  ^ as  a p-th  order  process  where 
1 s p < ot,  and  in  fact,  an  application  of  Tlicorem  2 of  [Wolfe  1973]  shows 
that  the  two  norms  on  L(?)  are  equivalent. 


2.1.2  PROPOSITIOU.  If  z,  is  a SaS  random  variable  with  e.. 


♦ tr)  . then 


• c(p,a)|U||  , 


where  1 < p < a and 


c(p,a)  = 


0.  - n .1 

2^"^/  s “ (1-e'^l 


op  I 

( "P'l  • “ t 
a J V ' sin  V dv 

0 -I 


ITiis  proposition  shows  that  for  a SaS  process  1(0  is  the  com- 
pletion of  1(0  with  respect  to  either  norm. 


45 


Proof:  By  Theorem  2 of  [Wolfe  1973] , 


iP  - 0 


oo 

i r‘P'^[l-0(2r)]dr 


2/  V P ^sin^v  dv 
0 


OO  OO 

/ r’P'^[l-(})(2r)]dr  = / r'P‘^(l  - e‘ 


kiri2r| 


4llcll'’/V“  'Ve-=)ds 

a Q 


Substituting  back  into  (*) , we  get  the  stated  result. 


If  M is  a Banach  space  of  p-th  order  random  variables,  then  for 
each  CeM  we  define  a continuous  linear  functional  on  M by 


A^(n)  = f[n(OP'^] 

for  all  neM- 

If  M is  a Banach  space  of  SaS  random  variables,  then  for  each  QeM  we 
define  a functional  A^:  M -»-R  by 

for  all  neM.  The  linearity  of  A^  in  this  case  follows  from  Corollar>’ 
1.3.4  and  the  linearity  of  conditional  expectations.  For  the  continuity 
of  A^  note  that 


!A^(n)l  = li  XjCxp"'  r^^Jclx) 


by  Holder's  inequality.  Thus  is  a continuous  linear  functional  on 
UO  with  I |A^|  - I Id  1“ 


We  now  show  that  the  continuous  linear  functionals  thus  defined  on  1(C) 
represent  the  dual  space  1(C)*-  Although  no  reference  for  this  result 
is  known  to  us,  its  proof  is  analogous  to  the  argument  used  for  the 
Riesz  representation  for  continuous  linear  functionals  on  a Hilbert  space. 

2.1.4  LEMMA.  [Singer  1970,  Corollary  3.5  and  Theorem  1.11].  If  U is  a 
closed  linear  subspace  of  1(C)  and  ri2^el(C)  " W,  then  there  exists  a 

I 1 = infl In 

ncM 

for  every  neM. 

2.1.5  THEOREM.  Let  C be  either  an  ct-th  order  process  or  a SaS  process. 

If  A is  a continuous  linear  functional  on  1(C),  then  there  exists  a 
unique  CcLCC)  such  that  A = A^  {and  hence  | (A[  ~ I 1^  I 1°^  ^)  • 

Proof : Consider  M = {nel(C) : A(n)  = 0},  a subspace  of  1(C)-  If 
M = 1(C).  take  ^ = 0.  Otherwise,  choose  njcl(C)  - M,  let  H2  be  the  best 


unique  r]2^^  such  that  \ |n^'n2 


.-nil-  Moreover,  A _ (n)  = 0 
1 ^l’'^2 


Li 


approximation  to  in  M,  define  ~ 


^l'^2 


|ni-n2l  I 


, and  take 


lU-l 


C = [ACn,)]  n • For  every  nel(C)  OTite 
3 


n = n 
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Note  that  n - 


ACnJ 


CeM.  Thus 


|A(n-7) 


,a-l 


A^(n)  =A^ 


A(n) 


lACn,) 


a 

iOt-1 


by  Lemma  2.1.4.  Therefore 


A^(n)  = — ^ A^(0  = — I kl  1“  = A(n)  . 

lAtnj)!^^  |A(ri3)|“^ 

The  uniqueness  of  ^ follows  from  Holder's  inequality,  since  A = A 
implies  that 

\'TTfTT'  ■\‘wr)  ■ 11^11“''-  lltoir'  ■ □ 

We  no\v  obtain  some  auxiliary  results  which  will  be  useful  in  the 
development  of  the  stochastic  integral. 

2.1.6  PROPOSITION.  Let  <2  sequence  in  l(^)  such  that 

{An(?n)}^-i  aonverges  for  every  neL(5).  Then  converges  weakly  to 

some  CeL(C) • 

Proof : For  every  n let  Q^el(0**  be  defined  by 

Qn(^*)  = C*(L„) 

for  all  ^*eL(0*’  By  [Rudin  1973,  Theorem  2.8J,  Theorem  2.1.5,  and  our 
hyiiothesis,  we  can  define  another  element  Q of  !(?;)**  by 


Q(C*)  = lim  Q^(C*)  , 

n-H» 
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for  all  Since  1(C)  is  reflexive,  it  follows  that 

converges  weakly  to  c.  where  c corresponds  to  Q under  the  isomorphism 
between  1(C)  and  1(C)**.  □ 


In  the  development  which  follows  we  apply  a result  found  in  [Cudia 
1964]  to  show  that  the  map  c,  i— >A^  from  1(C)  onto  1(C)*  is  continuous 
with  respect  to  the  norm  topologies  (Proposition  2.1.7  and  Theorem 
2.1.10).  This  result  is  used  to  obtain  sufficient  conditions  for  a SaS 
process  to  have  weak  right  limits  (Proposition  2.1.11). 


2.1.7  PROPOSITION.  For  every  f€Lp(Y,T,v)  = Lp(v) , 1 < p < igt 

Af(g)  = / g(f)P'^dv 
Y 

for  all  geLp(v)  define  a continuous  linear  functional  on  Lp('^)  . Then  the 
map  Lp(v)  -*■  Lp(v)*  defined  by  f t— is  continuous  with  respect  to  the 
norm  topologies  of  lp(v)  and  Lp(v)*. 


Proof:  We  can  easily  check  that  the  function 

|(x)P~^  - (y)P'^l 


ix-y 


lP-1 


L 2-D 

is  bounded  on  R - {x=y}  by  c = 2*"  so 


(x)f’’^  - (y)^'^U  c|x-y|^'^ 


for  all  (x,y)fR  . The  result  then  follows  from  the  following  inequality: 

P P-1 

* = ii  dv)  P 

* ^ Lp(v)  Y 


J2_  nJ. 

< (/  cP'V-sl^dv)  P = 

P 


Y 
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Of  course  this  result  applies  to  the  map  r,  l— > from  Lp(Jl,F,P) 


to  Lp(Q,F,P)*  where 


\{r))  = Eh(0* 


but  we  shall  also  need  the  norm  continuity  of  the  map  ^ l— > when 

5 is  a SaS  process,  and 


A^Cn)  - / XiCxj)”'  r^^^(dx) 

for  all  nef(0-  In  [Cudia  1964]  the  continuity  of  such  maps  is  related 
to  properties  of  the  norm,  and  by  applying  the  development  there  together 
with  Proposition  2.1.2  we  shall  obtain  the  continuity  of  c |— > for  ^ 

belonging  to  a SaS  family  such  as  1(C)- 

Let  X be  a Banach  space,  let  U = {xeX:  | |x| | < 1},  let  C = 

{xeX:  I |x| I =1),  and  let  C*  = {fcX*;  | |f| | = 1}.  For  any  xeC  let 

be  the  set  of  elements  feC*  such  that  {y:  f(y)  = r}  is  a hyperplane  of 
support  of  U at  X for  some  r > 0.  Then  the  set  is  called  the  spherical 

image  of  x.  We  say  that  the  norm  on  X is  Freohet  differentiable  if  for 

all  xeC  the  limit 


exists  and  the  convergence  is  uniform  as  y varies  in  C. 


2.1.8  LEMMA.  [Cudia  1964,  Corollary  4.12].  The  norm,  on  X is  Freohet 
differentiable  if  and  only  if  the  spherical  image  nap  E defined  on  C is 
single-valued  and  continuous  from  the  norm  topology  on  C into  the  norm 
topology  on  C*. 


Notice  that  the  set -valued  function  E in  the  lemma  is  taken  to  be 
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a mapping  into  C*  when  the  image  is  a singleton  set.  We  shall  apply  the 
result  when  X = M,  a space  of  jointly  SaS  random  variables,  and  begin  by 
examining  the  spherical  image  map  in  this  setting. 

2.1.9  PROPOSITION.  If  M is  a linear  space  of  a-th  order  random  variables 

or  jointly  SaS  random  variables,  then  for  all  | IcM  " 1- 

Proof:  Let  (i  = {peM;  ||n|i  ^ 1}  and  recall  that  ^ = 1- 

Given  any  ped, 

A^(p)  ^ |A^(p)|  s Ikll^  ^IIpII  = llnll  ^ 1 , 

with  equality  implying  that  ? = n by  Holder's  inequality.  Therefore, 

A^(p)  < 1 for  pfU,  p C,  and  hence 

{pcM:  A^(p)  = 1} 

is  a hyperplane  of  support  of  U at  D 

2.1.10  THEOREM.  If  M is  a linear  space  of  jointly  SaS  random  variables, 
then  the  map  t,  i — > A^  from  M into  Af'  is  continuous  with  respect  to  the 
norm  topologies. 

Proof:  If  we  regard  A(  as  a subspace  of  L^(S1,E,P)  for  some  p such  that 

1 < jt  < a,  then  Propositions  2.1.7  and  2.1.9  together  with  I.emma  2.1.8 
imply  that  the  L^^(n)  norm  on  M is  Ercchct  differentiable.  It  is  therefore 
clear  from  Proposition  2.1.2  that  the  norm  ll’ll  on  M satisfying 
|jp|(  = - logff  (e^'^1  I is  Frechet  differentiable,  and  thus  the  map  c !— > A^ 
from  C into  C*  is  norm  continuous,  again  by  Lemma  2.1.8  and  Proposition 


2.1.9. 


SI 


We  complete  the  proof  by  showing  that  the  map  c |— > from  M into 

is  also  norm  continuous.  Indeed,  if^^-*-C?^0inM,  then 


M* 


1 

> 

3 

lk„ll“‘')A 

iTCT 

Tiy-I 

M* 


,a-l 


A 


M* 


A C. 


M* 


0 as  n and  if  0 in  M,  then 


,a-l 


I |A  I I = I kni  I ^ 0 as  n ->  <=0. 
^n  M* 


□ 


Under  the  conditions  of  Theorem  2.1.10  it  can  in  fact  be  shown  that 
the  map  c [— > A^  is  uniformly  continuous,  but  we  shall  have  no  use  for 
this  stronger  result. 

We  conclude  this  section  by  obtaining  sufficient  conditions  for  a SaS 
process  to  have  weak  right  limits  (assumption  (al)  of  Section  2) . This 
proposition  will  be  used  in  Section  3 to  define  /fdC  when  C is  SaS  with 
independent  increments. 

2.1.11  PROPOSITION.  Suppose  that  ^ a < t < b}  rs  a SaS  process 

ijith  1 < a < 2.  Let  = 0 for  some  t'  in  order  that  we  may  direct  oui^ 
attention  toward  the  elements,  rather  than  the  increments,  of  the  process. 
?he.yi  the  followi-ny  two  conditions  imply  that  for  each  Cef  (C)  . the  right 
limit  F^(t+0)  exists  at  every  t£[a,b),  where  T^(t)  = A^(5^]. 
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(al)  For  every  Se[a,b)  there  exists  > 0 and  an  < °° 

such  that  I |C^| I ^ whenever  s < t ^ s + e^. 

(0.2)  For  every  is  of  bounded  variation  on  T. 

Notice  that  condition  (al)  is  necessary  for  the  existence  of  the  right 
limits  F^(t+0)  and  that  conditions  (al)  and  (a2)  together  are  apparently 
weaker  than  assuming  that  ^ is  of  weak  bounded  variation. 

Proof:  Fix  ^ef(^)  and  let  ii(S)  be  such  that  By  (o2) , 

A (f^)  is  a function  of  bounded  variation  on  [a,b]  for  each  n;  so 

D (t)  = lim  A ) exists  for  all  te[a,b).  For  fixed  se[a,b),  applv 

" e fO  ^n  ^ ^m 
m 

(al)  to  get  Eg  ^ 0 snd  Mg  °°  such  that  | |f^|  1 ^ whenever  s < t < s + e 
We  shall  use  Theorem  2.1.10  to  show  that  {A  } is  uniformly  convergent  on 
s<t<s+e^}.  Indeed,  let  e > 0 be  given  and  choose  N such  that 
n > N implies  ( (A  -A  ( ^ • Then  for  every  te(s,s+c  ] and  n ■ N, 

and  hence  the  desired  uniform  convergence.  Now  by  a standard  result  for  a 
uniformly  convergent  sequence  of  functions, 


lim  A (£  ) = lim  lim  A (£;  ) = lim  D (s) 

c 4-0  ' ^m  e_f0  n-x»  ’n  ^m 

m m 


exists,  and  thus  the  right  limit  F^(s+0)  exists. 


□ 
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2.  The  integral  ^ f(t)d^^  . 


We  begin  this  section  by  defining  the  stochastic  integral  / f(t)d^^ 

T 

for  an  appropriate  class  of  (deterministic)  "functions"  f and  obtain, 
under  certain  (smoothness)  conditions,  an  integral  representation  for  the 
elements  of  L(0-  Our  approach  is  motivated  by  [Huang  1975]  where  the 
case  a = 2 is  treated. 

Let  C = (5^,teT}  be  either  an  a-th  order  or  a SaS  process  with 
T = [a,bj.  For  each  QeLCO  define  the  real-valued  function  on  T by 
F^(t)  = A (5  ) for  all  teT.  We  shall  begin  with  two  assumptions,  (al) 
and  (a2) , on  ^ , 

(al)  For  every  QeLCOf  assume  that  the  right  limit  F^(t+0)  exists 
for  all  te[a,b). 

In  other  words,  lim  A (r  ) exists  for  every  Cel(C),  so  that  the 

e -10  ^ ^ ^n 

n 

sequence  (^  } converges  weakly  in  L(0  by  Proposition  2.1.6  and  we 

^n 

denote  its  limit  by  Hence  F^(t+0)  = A^(C^_^g).  Let  be  equal 

to  and  let 

n 

I = {i;eLCO:  = I aj^(C^  +0'^t  +0^  where  n>l,  aj^eR,  and 

k~  1 k k"l  ..ii 

a=tn<t, <. . . <t  =b]  . 

0 1 n ^ 


(a2)  For  every  ^el,  assume  that  F^(t)  is  of  bounded  variation  on  T. 

Let  S be  the  linear  space  of  all  step  functions  on  T of  the  form 

f(b)  = ^ j(t)-  For  each  such  f define  /fdf;  to  be 

Ic  “ 1 Ic 

^k=l^k^^t  +0'^’t  +0^‘  Define  a norm  on  S in  terms  of  a Lebesgue-Sticltjes 

^k  ^k-1 
integral  by 


i 
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f 


m. 


" ■ H/fdell  • 

Let  be  the  conpletion  of  S with  respect  to  this  norm. 

Every  element  f of  can  be  represented  as  f = 3 Cauchy  seq- 

uence in  S.  It  follows  that  {/f^d^}  is  a Cauchy  sequence  in  L(0>  we 
will  denote  its  limit  by  /fd^.  Then  the  map  A^  LiO  defined  by 
f |— > /fd^  is  an  isometry  from  A^  onto  a closed  subspace  of  L(0 • 
we  assume  that  = 0 for  sane  t'^T  and  that  the  process  is  weakly  con- 
tinuous from  the  right,  then  this  isometry  will  be  onto  L(0 • 

Suppose  now  that  the  process  5 is  of  veak  hounded  variation  (see 
[Shachtman  1970]);  i.e.j  we  assume  that  F^(t)  is  of  bounded  variation  on 
T for  all  zeL(0-  This  condition  is  clearly  stronger  than  (al)  and 
(a2) , since  functions  of  bounded  variation  have  left  and  right  limits  at 
all  points.  Let  S'  be  the  space  of  all  bounded  measurable  functions 
f:  T -»  R for  which  there  exists  some  neL(C)  such  that  the  Lebesgue- 
Stieltjes  integral  J f(t)dF  (t)  equals  A (n)  for  every  c,eL(0.  Since 
the  dual  separates  points  on  L(C) , we  see  by  Theorem  2.1.5  that  f 
uniquely  determines  n and  we  denote  the  latter  by  ffd^.  It  is  immediate 
that  S'  is  a linear  space  containing  S and  that  the  definition  of 
/fdL  on  S'  extends  our  previous  definition  of  ffdt,  on  S.  As  before,  de- 
fine a norm  on  S'  by 

iifii“,=  / f(t)dF^^^^ct)  = A^^^^c/fdo  = ii/fdfjr . 


and  let  A'  be  the  completion  of  S'  with  respect  to  this  norm.  Then 


S5 


A c A'  and  as  done  above  we  can  define  an  isometry  from  A'  onto  a closed 
a a 'a 

subspace  of  L(C)-  Old*  next  result  shows  that  S is  strictly  contained  in 


2.2.1  PROPOSITION.  Let  ^ = {C^,a<t<b}  be  an  a-th  order  or  a SaS  process 
of  weal,  hounded  variation.  Then  all  continuous  functions  on  [a,b]  belony 
to  S' . 

Proof:  If  f is  a function  on  T and  it  is  a partition  of  [a,b]  defined 


by  a = t.<t.<...<t  = b, 


let  f^Ct)  = where 


is  an  arbitrary  point  in  ^^k'^k-1^'  ^ 

l<k3n 

is  a continuous  function  and  {tt^}  is  a sequence  of  partitions  of  [a,b] 

with  •*  0,  then  f eS'  for  every  n and 

n 

/ f(t)dF  (t)  = lim  /f^  (t)dF  (t)  = lim  A^(/f^  dO 
T n-+o°  T n ^ n^  ’ n 

for  all  cel(C).  Letting  n be  the  weak  limit  of  {/  f d^}  in  L(0 

(Proposition  2.1.6),  we  see  that  / f(t)dF  (t)  = A (n)  for  all  /^eL(0 

and  hence  fcS'.  ( 


Although  we  have  failed  to  resolve  whether  it  is  possible  that 

A ^ A'  when  C is  of  weak  bounded  variation,  we  now  show  that  A = A' 
a a a a 

when  C is  of  strong  bounded  variation,  which  is  defined  in  the  usual 


For  every  t( [a,b]  define 


V.(t)  = 

'y 


sup  I llA  As  II  ’ 

a=s„<-..<s  =t  k=l  ^k  k-1 
U m 


where  the  supremum  is  taken  over  all  finite  partitions  of  [a,t].  If 
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V^(b)  < 0°,  then  the  stochastic  process  ^ is  said  to  be  of  strong  bounded 
variation  (see  [Brdzis  1973,  p.  141]).  It  is  easily  seen  that  strong 
bounded  variation  implies  weak  bounded  variation. 

2.2.2  PROPOSITION.  If  K 'i-s  of  strong  bounded  variation,  then 

Proof:  For  every  i^eLCO  define  the  total  variation  function  |F^j  by 

m 

|F  l(t)  = sup  ^ I ’ 

^ a=Sn<...<s  =t  k=l 

U m 

and  note  that  for  t^^  < t^, 

iFjCtp  - |Fj(tp  < |Uir*^[VJt2)  - V^(t^)]  . 

Given  any  feS'  let  ^ sequence  of  step  functions  converging  to 

f in  L^(T,8j,,dV^).  Then 

. / |f(t)  - („(t)|d|F^(j.yj^|Ct) 

Therefore 

/IW  - V«l‘i''5(t) 

and  the  right-hand  side  converges  to  zero  as  n -*■  «>.  It  follows  that 
S 3 S' , so  that  A = A' . □ 

OL  a 

If  additional  conditions  are  placed  on  the  process,  it  can  be  shown 
that  other  classes  of  functions  belong  to  the  function  space  A^.  For 


instance,  if  the  process  ^ is  weakly  continuous,  i.e.,  if  F^(t)  is 
a continuous  function  on  [a,b]  for  all  ^eL(0>  then  S'  contains  all 
bounded  functions  that  are  continuous  when  restricted  to  a subset 
containing  all  but  countably  many  points  of  [a,b]. 
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3.  The  integral  / f(t)dr,  when  F is  SixS  with  independent  increments. 

.T.  t 


In  this  section  we  show  that  when  C is  a ScjS  process  with  independent 
increments,  the  function  space  is  an  space  C[Schilder  1970,  Tlieorem 
3.1])  and,  if  M is  the  subspace  of  L(C)  isometric  to  A^,  we  relate  the 
dual  elements  of  M to  dual  elements  of  the  space  (Proposition  2.3.1). 

As  a corollary,  we  identify  a separating  family  of  continuous  linear  func- 
tionals on  M (Corollan-  2.3.2). 

Suppose  that  ^ = {C^,a-'t<b}  is  a SaS  process,  1 < « <'  2,  with  indepen- 
dent increments  and  such  that  = 0.  B>’  Leiami  3.2  of  [Schilder  1970], 

cl 

IKt  -^t  ii't  II"  - li^  11" 

if  a < t^  s t^  s b and  therefore  is  an  increasing  function  on  [a,b], 

Notice  that  condition  (al)  of  Proposition  2.1.11  is  satisfied  since 

I l^tl  I - 1 l^bl  I te[a,b]. 

To  check  that  condition  (a2)  holds,  consider  QeliO  and 
a = tQ  < tj  •.  ..<  tj^  = b.  We  can  clearly  choose  a = . . . <s^  = b 

such  that  c {sj  and  ‘ ja^  ( ^).  Write  Xj  for 

4 -t,  , 1 < j s m,  and  let  M = jjA.  i|  ' max  |a.|*'‘  Applving 

^j-1  ' 1 j m ■' 

Corollary  1.2.3,  we  get  that 


A (X.  ) = / x,(Xt)‘  ■ m iiLx) 

S.,  ^ 1 


. - 1 

/ X ( /ax  . idx) 

k Je  , 1 ■'  ^ V 


where  1 < • m.  IhiL^ 


I lA  U )N  I |A  (C  ) 

k=l  ^ Vl  j = l ^ ^j-1 


ill  111 

I |A,(X.)1  = I |a. 
j=l  ^ ^ j=l  J 


iXj  I r s , 


and  the  bounded  variation  of  F^(t)  follows. 

Because  these  conditions  are  satisfied,  we  know  that  the  SaS  process 
is  well-defined  by  Proposition  2.1.11,  and  we  see,  after  a 
moment's  reflection,  that  it  has  independent  increments.  It  is  clear 
then  that  conditions  (al)  and  (a2)  are  satisfied;  so  the  integral  /fd^ 
is  defined  as  in  the  previous  section. 

Let  f and  g be  two  step  functions  in  S: 

f(t)  = I f.Xct  t " I SkXft  t 

j=l  J ^^j-1’  j]  k=l  ^ '■^k-l’^kJ 

where  f and  g are  defined  over  the  same  intervals  with  no  loss  of  generality 
Let  G(t)  be  the  increasing  function  | on  T.  Writing  Xj  for 

, 1 < j < n,  and  recalling  the  notation  of  the  previous 

section,  we  find 

= ? f.(gir'iix.ir 

j=l  J 

= / I t ](t)dr,(t) 

j=i  J J 


= / f(g)'^'’d(;(t)  . 
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In  particular,  I K I 1°*  = / f (t)dF  = /| f Ct)  |“clG(t} . We  conclude 


that  = L^(dG),  since  the  step  functions  are  dense  in  both  spaces. 

In  sunmary,  if  C is  a SoS  process  witli  independent  increments  and 
1 < a < 2,  then  we  have  shown  that  the  integral  /fd^  is  defined  and 
yields  an  isometry  between  a closed  subspace  of  1(f)  and  an  space. 

We  obtain  therefore  the  result  fomd  in  [Schilder  1970,  Theorem  5.1] 
without  any  continuity  assumptions  on  the  process.  Schilder  also  ob- 
tains an  analogous  result  for  the  case  0 < a < 1 . 

Our  definition  of  /fd^  in  this  section  easily  e-Ktends  to  the  case 
where  the  stochastic  process  f is  indexed  by  an  infinite  interval  T. 

If  we  let  S be  the  set  of  all  step  functions  that  are  zero  outside  a 
confiact  subintcrv'al , then  we  can  define  the  norm  on  S in  the  same  way 
as  before,  and  the  completion  of  S with  respect  to  this  norm  will  be 
L^(T,Rp,dG). 

It  will  be  useful  to  liavc  an  expression  for  certain  continuous  linear 
functionals  evaluated  at  points  of  the  form  /fdf. 

2.5.1  I‘h  'Fo:' IT  I • 'K . Let  n = /fd6  in^i  ~ /gd^,  where  f and  g belon,^ 


to  L^(dG).  Then 


A,(n)  = / f(R)‘*'^dG  . 


Proof:  hot  {f  } , and  fg  , be  sequences  of  step  functions  in  h (.dG) 

n n=  I n n= 1 ‘ a 

such  that  f^  -►  f and  g^  *•  g.  Then  j'^j^df  p and  j'gj^df,  and  therefore 


.V(n)  = Inn  A.(/f^d£;) 

= li-"  A 

ni-  xn  n -^'  ”n 


L 
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= lim  lijn  / 

m-H»  n-x»  I 

m+oo  T 

= / f(g)“'^dG  , 

T 

by  Theoran  2.1.10.  □ 

Let  i = {^^,teT}  be  as  above  with  T = [a,«>)  and  = 0.  Then  if 
M is  the  closed  subspace  of  L(0  vdiich  is  isometric  to  L^(dG) , we  get 
from  Proposition  2.3.1  that  the  set  of  continuous  linear  functionals 
{A  :teT}  separates  points  on  M. 

H+0 

2.3.2  COROLLARY.  If  ^eM  and  A = 0 for  all  teT,  then  ^ = 0 fn  M. 

n+0 

Proof:  Let  feL^(dG)  be  such  that  C = / f(t)dC^.  Then 

A (i;)  = 0 for  all  teT 

4+0 

=>  / f(s)dG(s)  = 0 for  all  teT 

(a,t] 

=-■=>  f = 0 a.e.  [dG] 

=>  C = 0 in  M.  □ 

If  C is  weakly  continuous  from  the  right,  then  L^(T,Bj.,dG)  is 
isometric  to  L(0  and  Corollary  2.3.2  implies  that  the  set  of  contin- 
uous linear  functionals  {A  : teT}  separates  points  on  l(^). 

As  a further  application  of  the  developments  in  this  section, 


1 


we  reexamine  a regression  problem  introduced  in  Chapter  I . 
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’I' 

[ 


m 

K 

I 

L 


2.3.3  PROPOSITION.  Let 
1 < a < 2,  such  ttuxt  trie 
and  = 0-  l''o^  everij 

X(B) 

“r,X<W 

''xx'W 


in.C^ be  a family  of  SaS  random  variables , 
process  {^^,a<tsb}  has  independent  increments 
Borcl  subset  H of  (a,b]  -b  fine 

" S{B)X(Bj  • 


Then  is  a f.s.m.  which  is  absolutely  continuous  with  respect  to  the 


measure  p 


XX' 


Moreover,  the  Radon- Nikod^fi  derivative  dy  „/dy.„.  relonas  to 

nX  X.X 


L^(dP) , where  F(t)  = 


, and 
dy 


E(n  1 »a<tsb)  “ / 


nX 


XX 


(t)d^^  a.s. 


Proof:  To  see  that  y^^  is  countably  additive,  let  B = U B^,  where  the 
B^’s  are  disjoint  measurable  subsets  of  (a,bj.  Then  using  Theorem  2.1.10 
and  the  techniques  of  this  section,  we  have  that 


'nX(B) 


lim  C 


n 

= lim  )"  C 

n-KX5  i = ] 


nX(Bp 


00 

r 


ii/'nX 


(B.) 

I 


It  is  clear  that  dy^^ 
of  (a, hi  such  that 


dr  and  y .. 

nX 


XX' 


Let  T be  a coiuitable  subset 

a' 


E(n|f^  ,a^t<b)  = Etn!b^,ttTJ  . 

Without  loss  of  generality,  we  may  assiDiie  that  the  points  in  T^  arc  dense 
in  (a,b|,  order  tliem,  and  let  T^  be  the  set  containing  the  first  n points. 
We  know  from  the  discussion  in  Chapter  1 and  I’roposition  2.1.2  that 


1 

f 

I 
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T 


y .. 


k 


4.  Spectral  representation  of  a SgS  process. 

In  this  section  we  state  an  interesting  result  due  to  Kuelbs  (2.4.1) 
and  derive  Schilder's  characterization  of  independence  (Theorem  2.4.2) 
from  the  characterization  in  Theorm  1.2.1.  A simple  result  on  estima- 
tion of  SoS  random  variables  is  also  included  (Proposition  2.4.3). 

In  [Schilder  1970]  the  integral  where  c is  a SuS  process  with 

independent  incranents,  was  used  to  obtain  a "spectral  representation" 
for  a finite  set  of  jointly  S(.iS  variables.  Kuelbs  has  extended  this 
result  to  processes  indexed  by  an  infinite  set. 

Two  stochastic  processes  {^^,teT}  and  fn^.teT}  having  the  same  index 
set  are  called  indistinguishable  if  their  finite  dimensional  distributions 
are  the  same. 

2.4.1  [Kuelbs  1973]  Let  (C^.teT}  be  a SoS  process  that  is  continwous 
in  probability  with  T an  interval  and  1 < a < 2.  Then  there  exist  a SaS 
process  "1/2  < i < 1/2}  with  indeperuient  increments  a>ud  a family 

of  functions  {f^,teT}  in  L^(["  > where  I'(>0  ==  such 

that  (/  f^ (A)d^^ ,tcT}  and  are  irodistinyjyuishahle. 

Let  us  consider  two  jointly  ScS  random  variables  and  1 < a ^ 2. 
By  2.4.1  these  variables  have  the  same  joint  distribution  as  two  random 
variables  / fj(A)dc(A)  and  / f7(A)dr.(A),  where  -1/2  l A < 1/2}  is  a 

SaS  process  with  independent  increments,  F(A)  = and 

fieL^([-l/2,  1/2], dp)  for  i = 1,2.  The  following  condition  for  indepen- 
dence of  and  r.2  is  expressed  in  terms  of  f^  and  f2* 


I 
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I 


2.4.2  THEOREM.  [Schilder  1970]  The  random  variables  / f.  (Ajdi;- 

J.  A 

and  / f2(A)d^^  are  independent  if  and  only  if  ^^^^2  ~ ® a«e.  [dF]. 

Proof:  The  random  vector  C/  f]^(A)dc^,/  f2(A)d^^)  has  c.f. 

i [r^/f j (X)d^^+r2/f2(A)dc^l 


E e 


exp{-/|r^fj(A)+r2f2(A)  |°‘dF(x) } 


Let  f(A)  = [f^(A)  + f^CA)]^''^,  and  define 


§2^^)  = 


fjCA) 

TTaT 

1 


if  f(A)  > 0, 


if  f(A)  = 0, 


g2(^)  = 


fo(A) 

fixr 

0 


if  fCA)  > 0 , 
if  f(A)  = 0 . 


Let  S = {(Xj^,X2):Xj  ^2  ~ define  T:  [-1/2, 1/2]  ^ S by  T(A)  = 

(g^(A) ,g2(A)) , and  define  a finite  measure  v on  [-1/2, 1/2]  by  v(dA]  = 
f°‘(A)dFCA).  Then 

/|r^fj(A)+r2f2(A)|“dFCA)  = Jl<r,T(A)>l%(dA) 


= / 


|<r,x>|“vT  ^(dx) 


By  Theorem  1.2.1  we  have  independence  if  and  only  if 

0 = vT  ^{xeS:  Xj^X2/0}  = v{  Ae  [-1/2 ,1/2]  : g2  (A)g2CA)/0) 

= v{Ae[-l/2,l/2]:  f2CA)f2CA)/0} 

/ f“(A)dF(A)  . 

{A,  [-l/2,l/2]:fj(A)f2(A)/0} 

Since  f(A)  > 0 whenever  fj^(A)f2(A)  / 0,  the  result  follows.  □ 

Notice  in  this  theorem  that  the  index  set  [-  •^,^]  plays  no  essen- 
tial role  and  could  be  any  interval. 
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In  Theorem  5.2  of  [Schilder  1970)  a necessary  and  sufficient  condi- 
tion is  given  for  the  best  estimate  of  a ScxS  random  variable  by  a linear 
ccmbination  from  a finite  set  of  SaS  random  variables.  In  the  following 
result  we  solve  an  estimation  problem  in  an  infinite-dimensional  space 
of  random  variables  and  provide  an  explicit  exj^ression  for  the  estimator. 


2.4.3  PROPOSITION.  Let  t'e  a SoS  ri'i  witk  {ndepender.t 

increments,  1 < a < 2,  for  all  teT,  and  Fft)  = | 1*^.  Let 

I be  a subinteimaal  of  T and  dew  tc  by  L(l)  the  linear  space  of  the 
increments  of  the  process  formed  from  all  subintervals  of  1.  If 
P ~ f f(i)dC.j.,  where  feL^(dF) , then  the  best  approximation  to  n in  L(I)  is 
given  by 


n = / 

1 


Proof : If  I'  = T-I,  then  for  any  fixed  CeLll)  we  can  write  C = / g(t)df;^ 

T ^ 

where  geL^(dP)  and  g(t)  = 0 if  tel'.  Observe  that 


n - n = / ^(t)d^  , 

r 

and  therefore  n " n and  ^ are  independent  by  Theorem  2.4.2.  Thus 

A (v(c)  = / X,  /.(dx)  = 0,  so  that  A ..  annihilates  1(1). 

n-n  ^12  C.n-n  n-n 

Using  a standard  argument, 


1 

|p'^i  r‘  = = A^.^(n) 

= A ^(n- '.)  < 1 1 n-n|  ^ 

n*  r)  ‘ ' ' ' 

whence 

1 |n-fi|  1 • 1 ln-',|  1 

for  all  r,tL(I). 
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5.  The  integral  / £(t)f  vCdt)  . 

T i 

The  integral  / f(t)dr  discussed  in  Section  2 requires  two  assum- 
T ^ 

ptions  on  the  process  ^ and  consequently  is  somewhat  restricted  in  its 

applicability.  Even  when  these  assunptions  hold  (such  as  when  ^ is 

SoS  with  independent  increments),  there  is  no  direct  relation  between 

the  sample  paths  of  ^ and  the  realizations  of  / f(t)dr  . In  contrast, 

T 

the  integral  / f(t)^  v(dt)  which  is  defined  and  discussed  in  this  sec- 
T 

tion  requires  less  stringent  assumptions  on  C and  for  a large  class  of 
functions  f can  be  interpreted  as  a sanple  path  integral  (Theorem  2.5.5). 

Throughout  this  section  we  shall  consider  ^ to  be  a general  p-th 
order  process,  p > l,and  q to  be  such  that  1/p  + 1/q  =1.  A stochastic 
process  {^^,teT}  on  a probability  space  (fi,F,P)  is  called  measurable 
if  (t,(jj)(— > C(i»w)  is  a product  measurable  map  from  Txf^  into  R.  We  shall 
investigate  conditions  for  the  existence  of  measurable  p-th  order  pro- 
cesses in  Chapter  III.  The  following  argument  is  taken  from  [Cambanis 
and  Masry  1971]  where  it  is  applied  to  a second  order  process. 

2.5.1  PROPOSITION . Let  ^ = {^^,teT}  be  a measurable,  p-vh  order  process 
with  index  set  T an  arbitrary  interval  of  the  real  line,  and  let  a > p re 
given.  Then  there  exists  a finite  measure  v on  (T,Bp)  such  that  v is 
equivalent  to  Lebesgue  measure  on  T and 

! lujrv(dt)  < . 

T 

Proof:  Choose  g^cL^  (T,Sp,Leb)  such  that  gj^  > 0 a.e.  [Leb]  on  T,  and 

define  g2  on  T by 
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gzCt) 


= < 


if  0 < IK^II  - 1 . 
if  1 < • 


n 


Then  the  measure  v on  (T,B^j  defined  by  v(dt)  = clearly 

equivalent  to  Lebesgue  measure  on  T and 

/ i Ic.l  l“v(dt)  =/  I 1 |“g,  (t)g,(t)dt  < / g,(t)dt  - . 
it  r 1 . 1 

Under  the  conditions  of  Proposition  2.5.1, 

E/|e^(L0)lfv(dt)  = /li^ll'v(dt)  < - , 

since  p < a and  v is  a finite  measure;  so  the  sample  paths  belong 

to  Lp(T,B.p,v)  with  probability  one,  by  the  measurability  of  K and  Fubini's 
theorem.  We  can  therefore  define  a stochastic  process  n = {p^,teT}  by 

? (u))v(dsj  a.s. 

(-o",t)nT  ' 


for  each  teT  and  observe  that  since 


ElnJ’"  = E|  / C^(m)v(dt)|f  < {v[(-oo,t)nT]}f/%/lC  fu))|fv(dt) 
^ C-»,t)nT  ' T ^ 


< 00 


2.5.2  LEMMA.  If  t^  < t^,  then 


'E^.Ca))v(dsll  1 < / "1  |v(ds)  . 


Proof:  Let  r.(ai)  = / (w) v(ds)  and  observe  that 

^1 

^2  f ■> 

Ikll'’  = Ki!  f.JuOv(dsl)  = / “A  (C^)v(dsl 

h ■ t ' 

< Kell'’''/  llyllvws)  • 


n 


2.5.5  PHOroSITJON.  The  stcehantic  ; >v\.v.s.?  t)  ?'«  of  I'trono  hounded 


variation. 
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Proof : 


For  every  partition  t^  < tj<...<tj^  of  T and  every 


n 


I I lU 
^=1 


|v(ds) 


^ / I IC.-I  |v(ds)  < °o  . □ 

T 

It  follows  that  the  stochastic  integral  / f(tjdn^  is  defined  for 
feAp(n)  as  in  Section  2 and  that  Ap(p)  = (Proposition  2.2.2).  We 

now  define  ^p(S)  - ^p(n)  and  for  every  feAp(C) 

/ f(t)C^v(dt)  = / f(t)dn^  . 

T T 

We  shall  see  that  the  "stochastic  integral"  / f(t)^.v(dt)  can  be 

T 

expressed  as  a sample  path  integral  for  a large  class  of  functions  in 

(Lemma  2.5.4)  and  that  sample  path  integrals  of  the  form  / f (t)C^ (w)v(dt) 
P T 

belong  to  L(n)  for  all  feL  (T,B„,v)  (Theorem  2.5.5).  In  addition,  these 
sample  path  integrals  are  dense  in  1(C)  when  C is  a weakly  continuous 
process  (Theorem  2.5.6). 


We  begin  our  investigation  of  Ap(C)  by  recalling  the  space  of  func- 
tions S'  which  generates  A^(n):  S'  is  the  space  of  all  bounded  measurable 
functions  f:T  -*■  R for  which  there  exists  some  nQel(n)  such  that  the 
Lebesgue-Stieltjes  integral  / f(t)dF  (t)  equals  A (Pn)  for  all  ^el(n). 

rp.  4 Q U 

Since  the  stochastic  process  n is  suppressed  in  our  notation  F^(t)  here, 
we  emi^hasize  that  F (t)  = A (n^) . 

2.5.4  LEMMA.  For  every  feS'  the  sample  path  integral  / f (t)C^ (oj)v (dt) 

T ^ 

equals  j f(t)C-v(dt)  with  probability  one. 

T ^ 
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Proof : It  is  clear  that  the  samiile  path  integral  exists  since  f is  a 


bounded  function  and  ^^(cojeL^tv)  a.s.  For  any  given  there  exists 

some  n-ieLCn)  such  that  A = A on  L(n)  by  Theorem  2.1.5.  Note  that  for 

s n 1 


t,  s t, , 


2 2 

- \ [ ! Cj'^)v(dt)]  = / A (C^lv(dt) 


A (/  f(,t)^*v(dt)  - / f(t)f  (cj)v(dt)) 

C rp  L rp  L 


= A.il  f(t).%.v(dt))  - f(t)ZAcj)v(dt)} 

c,  rp  L L 


= (/  f(t)C.v(dt))  - / f(t)E[(c)‘"'\]vfdt) 

I -1  rp  ^ rp  L 


/ f(t)dF  (t)  - / f(t)A  )v(dtj 

'I'  ' 1 2 'I'  ‘ L 


= / f(t)di^^  (t)  - / f(t}dF^  (t)  = 0 . 


all  ffL 


We  have  seen  that  (w) eLj^(T,8vp ,v)  with  probability  one,  so  that  for 
fL  (T,R^,v)  the  sample  path  integral  / f(t)C^ (w)v(dt)  is  defined  a.s. 

1 I 


and  is  easily  seen  to  belong  to  In  fact,  it  belongs  to  L[r,) , and 


the  function  space  ■^p(E)  contains  Lp(v)  in  a sense  which  we  now  make 


precise. 


2.5.5  THEOREM.  Evciv-  j’uyiatioyi  fel.^^(v)  def (’rmiyier.  uniquctu  ayi  elcmeyit 


,‘yuah  thzt 
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/ f(t)C^(w)v(dt)  = / f(t)C^v(dt)  a.s.  , 

T T 

where  the  left-hand  side  is  a sample  path  integral  and  the  right-hand 
side  a stochastic  integral. 


Proof : Given  any  geL  (v)  let  C = / g(t)C^(w)v(dt) , and  observ^e  that 

M rp  r 

I kl  = Aj/  g(t)5jco)v(dt))  = / g(t)AjC^)v(dt) 

^ IIsHl 

s IIsIIl  ■ 

Thus  we  have  the  relationship 

11/  g(t)Ct(‘^)v(dt)||  < l|g|lL^(^)(/IUJ|Pv(dt))^/P 
for  all  geLq(v). 

OO 

Given  any  feL^Cv)  let  be  a sequence  of  step  functions  con- 

verging to  f in  I-q(v)  and  recall  that  fj^eS'  for  each  n.  Thus  the  sample 

path  integral  / f (t)^  (w)v(dt)  belongs  to  L(n)  bv  Lemma  2,5.4,  ;uid 
T 

l|/[f(t)-f^^(t)|f;ja,)v(dt)l|  < ||f-fj|, 

T 'q^  T 

which  converges  to  cero  as  n so  that  the  sample  path  integral 

/ (.k))v(dt ) belongs  to  l(n)- 

T 

a> 

Note  that  is  a Cauchy  sec]uencc  in  S',  since 

q T 
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as  m,n  ->■  «>,  and  denote  its  limit  in  ^p(^)  by  f.  Then 

11/  f(t)f  (o))v(dt)  - / f(tjf  vCdt)|  1 
T T 

= lim  ll/[f^(t)-f^(t]li;j.Mv(dt)ll  = 0 , 
m,n-«°  T 

so  that 

/ t'(tJf^(Ljjv(,dt)  = / f(t)4^v(dt)  a.s. 

It  is  immediate  that  f determines  f uniquely,  since  if  in 

Xp(0  satisfy 

/ g-(tlf^v(dt]  = / f(t)f^(w)v(dt)  a.s, 
for  i = 1,2,  then 

llgf-gzllx  " I I = 0 ’ 

whence  = g^  in  □ 

Identifying  f with  f we  can  then  consider  L^(v)  as  a subset  of 
Xp(C).  It  is  straightfoiTvard  to  check  that  the  process  n is  continuous 
in  p-th  mean  and  consequently  that  ^p(0  is  isometric  to  all  of  L(n). 
Since  S'  c b^^{v),  it  is  clear  that  is  always  dense  in  and 

hence  that  L fvj  is  isometric  to  a dense  subset  of  f(n).  The  final  re- 
suit  in  this  section  shows  that  is  isometric  to  a dense  subset  of 

L(C)  when  C is  weakly  continuous. 

2.5.6  THEOREM.  Suppose  that  C is  weakly  continuous  from  the  right  and 

that  T = [a,<”).  Then  the  closure  of  {j  f ft)f^  (w)v(dt) : f is  a step 

T 


function}  in  Lp(n)  is  L(E,) . 


r 


Proof : Fix  t^T,  and  for  every  integer  n > 1 define 

B„(s)  . , 

SO  that 

I gj^(s)v(ds)  = 1 . 

Given  any  e > 0 and  any  , use  weak  right  continuity  to  choose 

an  N such  that  n > N implies  that  ^ ^ t < s < t + 1/n. 

Then  for  n > N, 

l\[^t  ■ j = 1/ 

^ / gj^(s)  |v(ds)  < ef  gj^(s)v(ds)  = e . 

Hence  / gj^(s)Cg(w)v(ds)  converges  weakly  to  by  Proposition  2.1.6 

and  therefore  C*.  belongs  to  the  closure  of  {/  f (t)C^(to)v(dt) : f is  a 

T 

step  function}  by  [Rudin  1973,  Theorem  3.1.2].  □ 

Thus  when  C is  weakly  continuous,  every  element  of  L(C)  can  be  ex- 
pressed as  a limit  in  Lp  (and  hence  also  a.s.)  of  sample  path  integrals. 
Specifically,  if  ^€L(C),  then  there  exists  a sequence 
such  that 

r,(o))  = lim  / f (t)C-(to)v(dt)  a.s. 

n-K»  T ^ 
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6.  The  integral  / f(tK,.v(dt)  when  T.  is  SaS  with  independent  increments. 

T 

When  5 is  SaS  with  independent  increments  and  fcL  we  find  the  relation- 

M 

ship  between  the  two  integrals  of  Sections  2 and  5 (Theorem  2.6.1),  and  we 
characterize  the  independence  of  / f^(t)5^v(dt)  and/  f,(t)5^v(dt) 

(Theorem  2.6.3). 

Let  C = {C^jteT}  be  a SaS  process  with  independent  increments,  index 

set  T = [a,“>),  = 0,  weak  continuity  from  the  right, and  F(t)  = ||C,.I|°‘. 

The  process  E,  is  therefore  a p-th  order  process  for  any  p such  that 

1 < p < a,  and  the  integral  / f(t)^^v(dt)  is  defined  as  in  the  previous 

T ^ 

section.  Under  the  conditions  we  have  placed  on  C,  we  know  in  fact  by 

Theorem  2.5.5  that  integrals  of  the  form  / f(t)C^v(dt),  where  feL  (T,B.„,v)  , 

y L q 1 

1/p  + 1/q  = 1,  are  dense  in  L(C) . The  following  Fubini-type  result  re- 
lates this  integral  to  the  one  in  Section  3. 


2.6.1  THEOREM.  //  feL  (T ,B„ ,v) , then 

M •* 

/ f(s)C  v(ds)  = / /“f (s)v(ds)dc  . 

T T u 

Proof:  We  begin  by  showing  that  the  right-hand  integral  exists,  i.e.,  that 

/”f(s)v(ds)cL  (dF) . Since  v is  a finite  measure  (Proposition  2.5.1),  we 
u 

can  choose  M so  large  that  v[M,“)  < 1.  Thus 

oo 

/!/  f(s)v(ds)|“dF(u) 
u 

^ /(/|f(s)l%(ds)]“/'^(/  v(ds))“/5'dF(u) 

T T u 

" I Ip  (^)/[v[u.“’)l“^^’dF(u) 

M , 

I Kl  I?  ( 'll/  [v[u,'")  )^'^dF(u)  + / v[u,'»')dlUu)  I 

a M 


rTMW^T 
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which  is  finite  since 


/ [v[u,oo)]“'^PdF(u)  < v(R)“^Pf(M)  < 00 


/ v[u,oo)dF(u)  <11  Xr,,  (s)v(ds)dF(u) 

M -p  T ^ 

" ( I X^^^sjMdF(u)v(ds)  < /lUjTvCds)  < 

by  Proposition  2.5.1. 

We  complete  the  proof  by  showing  that 

00 

A.  (/  f(s)^  v(ds))  = Ar  [f  f f(s)v(ds)d£  } 
i^t  T ^ '’t  T u ^ 

for  all  teT  and  applying  the  remark  following  Corollary  2.3.2.  Indeed, 

OO  00 

A.  (/  / f(s)v(ds)dU  = / / f(s)v(ds)dF(u) 

n T u T u 

by  Proposition  2.3.1.  Also, 


Ar  (I  f(s)C„vCds)) 


= / f(s)A,  (£  )v(ds) 
T ^t 


■ I i X(a,t)<“>  X(a_5|(u)JF(u)v(Js) 


{ I X|u,,)(alJF(u)v(ds) 

OO 

■/”  Xffl  /f(sIv(ds)dF(u) . 

T u 


The  following  corollar>'  is  iimediate  in  vieiv  of  Proposition  2.3.1. 


2.6.2  COROLLARY-  If  f and  g belong  to  L^(T,B.^,,v) , then 


A Lso  y 


Vf(s)5,v(ds)(( 


= /(/  f(s)v(ds))“’^{/  g(t)v(dt)}dF(u) 
T u u 


}/  f(s)£  v(ds)ti“  = /!/  f(s}v(ds)|'"dF(u) 
T ' T u 


As  another  application  of  Theorem  2.6.1  we  obtain  necessary  and  suf- 
ficient conditions  for  independence  of  such  integrals. 

2.5.3  THEOREM.  Let  P(t)  be  strictly  inareasing , and  for  i = 1,2  consider 
f^f_L  ri’,Sj.,v)  with 


B.  = {ueT:  / f.(t}v(dt)  = 0} 
u 

and  B!  = T-B^.  Then  f f ^ (t)£,^vfdt ) afid  j f2(t)C^v(dt)  are  independent  if 
anrl  only  if  one  of  the  following  two  (etjuivalent)  conditions  hold: 

(i)  f|  =0  a.e.  [v]  on  Ely  and  for  each  ueB^ 

00 

/ X (t)i'i  (t)v(dt]  = 0; 
u B2 

fii)  f2  = 0 (i.e.  [v]  on  Bj  and  for  each  ueB| 

oo 

/ Xn  (t)f2(t)v(dt)  = 0 . 

u 1 

IVoof If  I fj(t)^^v(dt)  and  / f2(t)C^v(dt)  are  independent,  then 


/ f^(t)v(dt)J  f2(t)v(dt)  = 0 
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a.e.  [dF]  by  Theorem  2.4.2  (with  a slight  modification  of  the  index  set 
of  the  process).  Thus  (*)  holds  for  all  UeT,  since  the  integrals  are 
continuous  functions  of  u and  F is  strictly  increasing.  Also  by  contin- 
uity of  the  integrals,  B2  is  a closed  set  and  hence  (a,“)  - B2  is  an  open 
set  on  which  (t)v(dt)  is  zero.  Therefore  fj  = 0 a-e.  [v]  on  B^  and 
consequently 

00 

/ Xn  (t)fjCt)v(dt)  = 0 
u 2 

for  all  ueB^. 

The  necessity  of  (ii)  follows  in  a similar  manner,  and  the  converse 
can  be  seen  by  reversing  the  argument.  □ 

It  is  possible  to  obtain  similar  conditions  for  independence  for 
slightly  more  general  F,  allowing  say  F to  be  constant  on  a closed  subset 
of  (a,“)  but  strictly  increasing  elsewhere. 
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7.  System  identification. 

In  earlier  sections  it  has  been  convenient  to  use  to  denote  a 
continuous  linear  functional  defined  by  A^(n)  = E[n(c)^  on  a p-th 
order  family  and  by  A^(n)  = on  a SaS  family.  We  shall  now  refer  to 
A^(n)  in  both  cases  as  the  covariation  of  n with  C and  likewise  extend 
the  use  of  the  symbol  to  the  p-th  order  case.  The  covariation 
function  of  a stochastic  process  C = is  defined  by 

C^^(s,t)  = , 

and  the  cross  covariation  function  Cy^  of  a stochastic  process  X = {X  ,VeV} 

At,  V 

with  C is  defined  by 

Cj^^(v,t)  = . 

Let  the  p-th  order  process  C be  the  input  to  a linear  system  and  let 
its  output  X be  given  by 

(1)  X„  = / 

where  f = {fy(*)>  VeV)  <=  S' , or  by 

(2)  X^(o))  = / fy(t)5^(o))v(dt) 

where  f = (f  (•)>  veV}  c L (v) . In  both  cases  f is  called  the  (time 

V ^ 

varying)  inpulse  response  of  the  system.  Our  purpose  is  to  investigate 
what  can  be  determined  about  the  system  from  knowledge  of  the  statistical 
rel.it ionship  between  C and  X,  specifically  from  knowledge  of  the  co- 
ition function  of  C and  either  the  covariation  function  of  X or  the 
v.iriation  function  of  X with  5. 

I Sii.s  with  independent  increments  we  find  that  the  impulse 
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response  of  the  system,  in  both  cases  considered  above,  can  be  iden- 
tified from  the  cross  covariation  of  the  output  with  the  input  process 
(Propositions  2.7.3  and  2.7.5).  With  additional  restrictions  it  is 
also  possible  to  determine  the  impulse  response  of  system  (2)  from  the 
covariation  function  of  the  output  process  (Proposition  2.7.6)  and  from 
the  cross  covariation  of  the  output  with  a known  stationary  sub-Gaussian 
input  process  (Example  2.7.1). 

For  a p-th  order  process  ? of  weak  bounded  variation,  the  cross 
covariation  function  for  system  (1)  is  given  by 

C,^(v,t)  . / f„Cs)dep  . / , 

and  it  is  clear  that  the  function  C^^(v,t),  teT,  determines  f^  if  and  only 
if  the  signed  measures  determined  by  C^^(*,t),  teT,  separate  points  on  S'. 
Similarly,  for  a measurable  p-th  order  process  5,  the  cross  covariation 
function  for  system  (2)  is  given  by 

Cx^(v,t)  = ( / f^(s)?gV(ds))  = / f^(s)C^^(s,t)v(ds)  , 

and  determines  f^  if  and  only  if  the  functions  C^^(*,t),  teT, 

separate  points  on  Lq(v). 

One  situation  in  which  system  identification  is  possible  is  when  the 
covariation  function  C^^(s,t)  of  the  input  process  is  a stationary  co- 
variance  function,  an  interesting  circumstance  which  arises  for  certain 
stationary  sub-Gaussian  processes.  To  see  the  form  of  C^^(s,t)  for  a 

general  a-sub-Gaussian  process,  let 

_ a ct 

A“,t(i"i»r2)  = 2 ^[rjR(s,s)  + 2rjr2R(s,t)  + r2R(t,t))^  , 
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for  every  s,teT,  where  R(s,t)  is  a covariance  function  and  1 < a. 
Then  observe  that 

f fc  t")  = i fJ-E i £_ 

^ ct  3r^  r^=0 


2 '^[r^R(s,s)+r2R(s,t)] 

2^ 

[r^R(s,s)+2rj^r2R(s,t)+r2R(t,t)]  ^ 


R(t,t) 


2T^R(s,t) 

2 


2.7.1  EXAMPLE.  Suppose  that  ^ is  a p-th  order  process  of  weak  bounded 
variation  having  covariation  function 


C^^(s,t)  = cR(s,t)  , 


where  c > 0 and  R is  a covariance  function  of  the  form 


R(s,t)  = / ^^g(r)dr 


with  g(r)  > 0,  geL]^  (Leb)  . Assuming  that  /'”|r|g(r)dr  < <»  , we  obtain  for 

-00 

system  (1)  the  cross  covariation 


C^^(v,t)  = / f^(s)d^C^^(s,t) 


00  00  . 

= / f (s)(c  / (-ir)e^’"^^  ^\g(r)dr)ds 


= -ic  / re^^^g(rll  / c''’’^f^(s)ds)dr  . 

-00  - oo 

Thus  knowledge  of  Cy^iv.t)  for  all  t and  of  g determines  / e ^^’'^f^islds 

-OO 
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i 


j 

f 

r, 

i 

'i- 

[V 

I 


for  all  r and  hence  f^(s)  a.e.  [Leb] . Assuming  moreover  that 
Cx^(v,t)eLi  (or  L2)  as  a function  of  t and  that  /°°  e ^’'^Cx^Cv.tjeL^ 

(or  L2)  as  a function  of  r,  we  can  express  the  impulse  response  as 

• °°  irs  °° 

^ reTFr  ^ ^ e'^’"^Cxj.(v,t)dt)dr  a.e.  [Leb]. 

If  we  suppose  instead  that  5 is  a measurable  p-th  order  process  with 
the  same  covariation  function  as  above,  then  we  obtain  for  system  (2) 
the  cross  covariation 


I 

! 


3 


i- 


Cx^(v,t)  = / fy(s)C^^(s,t)v(ds) 

= c/  fy(s)  / ^^g(r)dr  v(ds) 

-00  -00 

= c/  g(r)e^’^^/  f^(s)e'^^\(ds)dr  . 
-00  -00 


Thus  knowledge  of  Cyc-Cv,!)  for  all  t and  of  g determines  /°°e  ^’*^f  (s)v(ds) 

At  V 

^ -00 

for  all  r and  hence  f (s)  a.e.  [Leb] . Assuming  as  in  the  previous  case 

1 “ -irt 

that  Cx^(v,t)eLj  (or  L2)  as  a function  of  t and  that  ^ Cx^(v,t)dt 

cLj^  (or  L2)  as  a function  of  r,  we  can  express  the  impulse  response  as 


a.e.  [Leb] . 


-CO 


irs 

JTFT 


[ f e ^’'^Cyj.(v,t)dt)dr 
-00  ^ 


Throughout  the  remainder  of  this  section  we  assume  that  C is  a SaS 
process  and  use  the  special  properties  of  SaS  processes  to  obtain  more 
concrete  results.  We  begin  with  a simple  proposition  relating  covaria- 
tions in  the  output  space  with  the  finite-dimensional  distributions  of  X. 

2.7.2  PROPOSITION . Knowing  Ay(X^)  for  all  YeL(X)  and  all  VeV  is  equiv- 
alent to  knowing  the  f ini te-dimensiorial  distributions  of  X. 


i 

1 
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rr 

Proof:  Suppose  that  the  finite -dimensional  distributions  of  X are  known 


and  fix  YeL(X).  Then  Y = lim  Y^  where  each  Y^  is  a finite  linear  combi- 

n-K» 

nation  of  {X^,  vcV}.  For  every  veV  we  know  the  joint  distribution  of 
X and  Y , and  therefore  we  know 

V n 


Ay  (\)  = / Y 

n S v’  n 


and  thus  also 


lim  Ay  (X^)  = Ay(Xy) 

n-H”  n 


by  Theorem  2.1.10. 


Conversely,  if  Ay(X^)  is  known  for  all  YelCX),  then  for  any  integer 
n > 1 and  any  v^^, . . . .v^eV  we  know 


for  all  r^,, 


\,X  *...*rX 

1 V,  n V 1 n 

1 n 


= / |r  X +...+r  X |“r  (dx) 

S 1 ^ ’ V 

1 n 

. ,r^  and  hence  the  joint  c.f.  of  Xj,...,X^^. 


n 


Now  the  dual  of  L(X)  separates  points  on  /.(X);  so  each  X^  is  deter- 
mined in  L(X)  by  knowledge  of  Ay(X^)  for  all  YeL(X)  (Theorem  2.1.5), 
hence  by  the  finite-dimensional  distributions  of  X (Proposition  2.7.2). 
However,  L(X)  in  general  may  be  strictly  contained  in  M,  the  subspacc 
of  L(^)  isometric  to  A^,  and  the  set  of  linear  functionals  {Ay:  YeL(X)} 
may  not  separate  points  on  M.  In  such  cases  the  elements  of  the  output 
process  need  not  be  determined  in  M by  the  finite-dimensional  distribu- 
tions of  X.  (If  {Ay:  YeL(X)}does  not  separate  points  on  M,  then  there 
exists  r,eM,  ^ / 0,  such  that  Ay(;;)  = 0 for  all  YcL(X).  Thus  for  any  X^, 
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i 

t 


1 


= Ay(V 

for  all  YeL(X) , and  therefore  knowledge  of  the  finite -dimensional  dis- 
tributions of  X does  not  distinguish  between  X^  and  Xy+c  in  M.) 

Since  M and  are  isometric,  knowing  the  output  variable  X^  in  M 
is  equivalent  to  knowing  the  impulse  response  function  f^  in  A^.  Hence 
the  f inite-dimensionat  distributions  of  the  output  process  X determine 
f = {f^,  veV}  if  and  only  if  the  set  {Ay,  YeL(X)}  separates  points  on  M. 

An  interesting  example  for  which  the  system  is  determined  only  to 
within  an  equivalence  class  is  treated  in  [Kanter  1973] . In  that  paper 
Kanter  considers  a SaS  process  {^^,teR}  with  independent  increments  and 
I |“  = t and  a time- invariant  system  of  type  (1)  with  impulse  response 
feL^(R)  and  output 

X = / f(v+t)dC  . 

R 

Then  the  finite -dimensional  distributions  of  X determine  f up  to  trans- 
lation and  multiplication  by  ±1. 

To  see  how  system  (1)  can  be  determined  from  covariation  functions  in 
the  SaS  case,  we  assume  that  C has  independent  increments,  is  right  con- 
tinuous, T = [a,°o),  = 0,  and  |lC,.ll'^  = F(t).  Then 

CjjCs.t)  . I X(3,„i„(s,t)]WdF(r)  . F(n,in(s,t))  . 

Therefore  by  Proposition  2.3.1, 

Cx^(v,t)  = A^  ( / fy(s)dCg) 

= / f (s)dF(s)  = / f (s)d  C (s,t) 

(a,t]  ^ y V .s 

for  every  f^cL^CdP) , with  C^^(v,t),  teT,  determining  f^  if  and  only  if 
the  signed  measures  determined  by  C^^(',t'),  teT,  separate  points  on 
L (dF) . In  addition, 




C^(u,v)  = ( / f^(s)dC3)  = / f^(s)Cf^(s))“‘-^dF(s), 


and  consequently  is  determined  by  the  covariation  function  C^(u,v) , 

a-1 

VeV,  if  and  only  if  the  functions  f^  , veV,  separate  points  on  L^(dF) . 

2.7.3  PROPOSITION.  Suppose  that  ^ has  independent  inerements,  T = 
and  = 0.  Then  each  impulse  response  function  f^  is  determined  hy 

the  cross  covariation  function  C^^(v,  t+0) , teT.  Moreover,  assuming 
for  simplicity  of  expression  that  C is  weakly  continuous  from  the  right, 

f (t)  = lim  n)  - a.e.  [dF]  , 

rr*«  F(t^"is  ) - F(t^"^  ) 

k'-  nt)+l  k (t) 

where  F(t)  = |lC^||°^»  ^^k*^^^k=l  partition  of  (a,°°)  into  semiclosed 

intervals  ^^k^^ ’ ^k+1^  such  that  the  partitions  become  finer  as 

n increases  and 

6^^^  = sup  Leb(I^^^)  0 

k K 

as  n -*•  «=,  and  k^^^  (t)  is  the  unique  k such  that 

Proof : The  first  part  of  the  proposition  is  immediate  from  Corollary’ 

2.3.2,  and  the  second  part  follows  by  an  exercise  similar  to  (20.61) (b) 
of  [Hewitt  and  Stromberg  1965]. 

For  a discussion  of  the  estimation  of  Cj^^(v,t)  , see  [Kanter  and 
Steiger  1974] . □ 


2.7.4  EXAhtPLE.  Suppose  that  ^ satisfies  the  conditions  in  Proposition 
2.7.3  with  dF  a finite  measure  such  that  dF  ~ Leb  and 


/ t^dF(t)  = 


C < oo  . 


85 


Let  the  impulse  response  of  system  (IJ  be  given  by 

1 

fy(t)  = (cos  vbt)“*^ 

for  all  V s 0,  where  the  "frequency”  b > 0 is  unknown.  Then  for  each 
u > 0,  the  covariation  function 

oo 

C^(u,v)  = / f^(t)cos(vbt)dF(t) , Vv  > 0 , 

Si 

determines  f^^  a.e,  [Leb]  and  hence  b.  To  obtain  an  explicit  expression 
for  b,  observe  that 


d^C™(0,v)  ^ ^ 

5 = -dJ  t'^cos(vbt)dF(t)  , 

dv'^  a 


and  therefore 


,2  1 ** 

’’  ■ ■ ^ — Zi 


dv 


v=0 


We  next  consider  how  system  (2)  can  be  determined  from  covariation 
functions  and  therefore  assume  that  C is  a measurable  SaS  process.  Then 

Cj^^(v,t)  = / f^(s)C^^(s,t)v(ds)  , 

and  as  before  C^(v,t),  teT,  determines  f^  if  and  only  if  the  functions 
C^^(*,t),  teT,  separate  points  on  L^(v) . Assuming  that  K has  independent 
increments,  is  weakly  continuous  from  the  right,  T = [a,®),  = 0, 

and  F(t)  = | 1^,  then 

OO  OO 

Cyy(u,v)  = / ( / f (s)v(ds])(  / f (t)v(dt))“'MF(r) 

.j,  ^ u V 

by  Corollary  2.6.2,  and  we  shall  see  in  Example  2.7.7  that  the  covaria- 
tion function  C^^(u,v),  vcV,  sometimes  determines  f^. 


i 

I 
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2.7.5  PROPOSITION.  Let  5 be  SaS  with  independent  increments,  weakly 
continuous  from  the  right,  T = [a,“>),  5 =0,  and  F(t)  = | |5,-1  1^ 

strictly  increasing.  Then  for  each  fixed  VeV  the  cross  covariation 
function  C^^(v,t),  teT,  determines  in  L^(T,Rj.,v)  by  the  relationship 


d Lebn 


^ dc^,(v,0 


] (t)  a.e.  [Leb]  . 


Proof:  Observe  that 


C^^(v,t)  = ( / fy(s)5gV(ds)) 

/^d5^  T r 
a 

t “ 

= / / fy(s)v(ds)dF(r) 

a r 

by  Theorem  2.6.1  and  Proposition  2.3.1.  Thus  the  covariations  C^^(v,t) 

for  all  teT  determine  f°f^(s)'^(ds)  for  all  r since  F is  strictly  in- 

r 

creasing,  and  likewise  f^  is  determined  a.e.  [Leb]  since  v is  equivalent 
to  Lebesgue  measure.  D 

Applying  Proposition  2.7.2  to  system  (2)  we  see  that  knowledge  of 
the  finite -dimensional  distributions  of  the  output  process  X is  equiva- 
lent to  knowing  Ay(X^)  for  all  YcL(X)  and  all  veV.  In  this  case, 

Ay(\)  = Ay(  / f^Ct)5^v(dt)) 

= / f^(t)AY(5^)v(dt)  , 

where  for  each  Yel(X),  AY(5^)eLp(T,BY,v)  as  we  saw  in  the  proof  of 
Theorem  2.5.5.  Thus  the  finite -dimensional  distributions  of  X determine 
fy£Lq(T,Rp,v)  if  and  only  if  the  family  {Ay(5^) : YeL(X)},  a subset  of 
kp(v),  separates  points  on  L^Cv). 
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As  an  example  we  show  that  for  certain  systams  the  finite-dimensional 
distributions  of  X are  more  than  is  necessary,  and  in  fact  each  impulse 
response  function  f is  determined  in  L (v)  by  the  covariation  function 

U ^ 

C^(u,v),  veV. 


2.7.6  PROPOSITION . Let  ^ be  a ScxS  proaess  with  independent  increments , 
weakly  continuous  from  the  right,  T = F(t)  = | |'^  = t for  all 

tcT,  and  v(dt)  = h(t)dt  where  h is  chosen  as  in  Proposition  2.5.1.  Let 
{G^,veV}  be  a set  of  twice  differentiable  functions  in  Lp(v)  that  separ- 
ate points  on  L (v)  and  satisfy  G (0)  = 0.  Let  {g  , veV}  be  a set  of 

M V V 

differentiable  functions  related  to  the  functions  G^  by 


gyU)  = 


dG,ir)',a-l 


and  suoh  that  liin  g^(s)  = 0 and 

S-KO 

h(s)  ds  q 

for  all  VeV.  If  the  system  is  defined  by 

1 

■ ■ h(iT  ds 

for  all  veV,  then  each  f^  is  determined  by  the  covariation  function 
Cyj(u,v),  VeV. 


Proof : Given  ueV,  then 


^XX 


T V 


= / CO  (^t^V(dt) 

T / / f (s)v(ds)df. 

T r 


i 
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t «>  , 

= / f„(t)  / ( / f (s)v(ds))“’-^dr  v(dt) 

t “ de  (s)  , 

= -/  ds)“-ldr  v(dt) 


T ” 0 r 

t 


= / f (t)  / Cg^(r))“'^dr  v(dt) 
T 0 


t dG  fr) 

^ ^ di- 

T 0 


= / fuCt)G^Ct)v(dt)  . 


for  each  veV.  Since  {G^,  VeV}  separates  points  on  L^fv) , it  follows 


that  f^  is  determined  by  C^(u,v) , veV. 


□ 


2.1.1  EXAMPLE.  Let  G^(t)  = e ^sin  vt  for  ve[0,“)  and  choose  h(t)  = 
min(l,t  (Proposition  2.5.1).  Then 


gyCr)  = 


K(r)l 


dr 


1 


= e 


r 

a-1 


(v  cos  vr  - sin  vr) 


1 

a-1 


and 


dgy(s) 


" h(s)  ds 


s 

a-1 


min(l,s  ^ 


(sin  vs  - V cos  vs) 


1 

a-1 


+ (v'^  sin  vs  + V cos  vs)  (sin  vs  - v cos  vs) 


2-g 

a-1 


which  clearly  belongs  to  Lq(v)  and  converges  to  zero  as  s -*■  «> 


An  alternative  approach  to  the  system  identification  problem,  when 
the  statistics  of  the  output  are  known,  is  to  investigate  which  systans 
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will  produce  the  same  output  (in  distribution)  to  the  same  input.  For 
each  system  f,  write 

V.v  , 

where  5 is  a SaS  process,  and  let  L(f)  be  the  space  of  finite  linear 
combinations  of  functions  in  {f^,  veV}.  Then  two  output  processes 

and  have  the  same  finite  dimensional  distributions  if  and  only 

if  the  map  from  L(f)  onto  L(g)  defined  by 


n 

k=l  ^ ^k 


n 


k=l  ^ 


for  all  integers  n > 1,  r^^, . . . .r^^eR,  and  Vj^, . . . ,Vj^eV,  is  an  isometry.  We 
shall  content  ourselves  here  with  discussing  the  simplified  problem  when 
V is  a singleton; 

(1)  X^  = / f(t)dC^  , 

(2)  Xf  = / f(t)C^v(dt)  . 

In  system  (1)  with  C a SaS  process,  we  have  X^  = X if  and  only  if 
I Kl  I51  I |g|  151-  Also,  if  f and  g are  bounded  functions  vanishing  out- 
side a bounded  set,  then  X^  = X for  all  SaS  C with  independent  increments 
if  and  only  if  |f(t)|  = |g(t)|  for  all  t.  For  system  (2)  with  C as  in 
Theorem  2.6.1,  we  have  that  ~ X^  if  and  only  if 

ix>  00 

11/  f I I L (dF)  " I I / 8 I 1 L (dF)  ■ 

r a r a 

Moreover,  for  bounded  functions  f and  g,  ^ \ ^11  such  inputs  C 

o 

if  and  only  if 
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I / fdv|  = I / )4dv| 
r r 

for  all  r. 

2.7.8  PROPOSITION . Consider  system  (2)  with 

= / cos(tA)d^^  , t > 0 , 

where  t,  = A > 0}  fs  a SaS  process  with  independent  increments, 

weakly  continuous  from  the  right,  such  that  F(A)  = | 1°^  is  a bounded 
function  and  F(0)  = 0.  Then 


Xf  = / <J)f(A)dC;^  , 

where 

|J>£(X)  = / f (t)cos(tA)v(dt)  . 
Consequently,  for  a given  ^ if  and  only  if 

and  X^  = X for  all  such  C,  if  and  only  if 

c> 

I 4>£-(A)  I = 1 4’g(X)  I 

for  all  A > 0. 

The  proof  follows  by  a familiar  line  of  argument. 


III.  PATH  PROPERTIES 


Some  known  path  properties  of  Gaussian  processes  can  be  easily 
extended  to  SctS  processes.  For  instance,  the  zero-one  laws  for  Gaussian 
processes  in  [Cambanis  and  Rajput  1973]  hold  as  well  for  SaS  processes 
with  no  change  in  proof  in  view  of  the  zero-one  law  for  stable  measures 
in  [Dudley  and  Kanter  1974]  (see  also  [Femique  1973]).  This  chapter 
extends  to  p-th  order  or  SoS  processes  certain  results  known  for  2nd 
order  or  Gaussian  processes.  Specifically  we  give  necessary  and  suffi- 
cient conditions  for  the  measurability  of  a p-th  order  or  a SaS  process 
(Section  1),  necessary  and  sufficient  conditions  for  the  integrability  of 
almost  all  paths  of  a SaS  process  (Section  2),  and  sufficient  and  neces- 
sary and  sufficient  conditions  for  almost  sure  path  absolute  continuity 
for  p-th  order  and  for  SaS  processes,  respectively  (Section  3).  These 
results  are  obtained  by  appropriate  modification  of  the  proofs  of  similar 
results  for  second  order  or  Gaussian  processes. 

1.  Measurability  of  p-th  order  processes. 

Let  5 teT}  and  n = (n^'  '‘-eT}  be  stochastic  processes  on  the 

probability  space  (n,F,P),  where  T is  a Borel  subset  of  a complete  separ- 
able metric  space  and  B(T)  denotes  the  Borel  subsets  of  T.  The  process 
n is  a modifiaation  of  F,  if  = n^l  = 1 for  all  teT;  n is  called 
measurable  if  (t,iji))  i— > n^-Cw)  is  a product  measurable  map  from  Txf^  into 
R.  The  existence  of  a measurable  modification  is  frequently  of  interest 
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in  the  study  of  path  properties. 

The  following  condition  for  the  existence  of  a measurable  modifica- 
tion is  contained  in  [Cohn  1972],  We  shall  use  5 to  denote  the  map 
t I— > and  shall  specify  the  range  space  when  required  for  clarity. 

Let  M be  the  space  of  all  real -valued  random  variables  on  (f2,F,P),and 
define  a metric  p on  M by 


pf^i’^2^  = [i+Ui-^r, 

for  all  Then  P metrizes  the  topology  of  convergence  in  probab- 

ility. The  process  C has  a measurable  modification  if  and  only  if  the 
map  5 from  T to  M is  Bor  el  measurable. 

For  p-th  order  processes  we  now  obtain  further  equivalent  conditions 
for  the  existence  of  a measurable  modification.  Our  line  of  proof  follows 
that  in  [Cambanis  1975a]  where  the  case  p = 2 is  treated. 


3.1.1  THEOREM.  Let  {^^,teT}  he  a p-th  order  process  with  p > 1 or  a 
SoS  process  with  1 < a < 2,  and  let  L(^)  be  the  linear  space  of  the 
process.  Then  the  following  are  equivalent: 

(i)  The  process  C has  a measurable  modification. 

(ii)  The  map  Z,:  1 ^ L(^)  has  separable  range  and  is  such  that, 
for  every  tpeT,  ||  is  B(J) -measurable. 

(•ii)  The  map  Z,-  T ->  L(C)  ts  Bor  el  measurable. 

(iv)  L(0  is  separable  and  for  every  ^eL(C)  the  function  F (t)  is 
Borel  mea,surable. 

It  suffices  by  Proposition  2.1.2  to  prove  the  result  for  p-th 
order  processes. 
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Proof:  (i)  implies  (ii).  Consider  a measurable  modification  of 

C.  Then  for  every  t^eT,  ||  = is  8 CT) -measurable 

u ^ ^0 

by  Fubini's  theorem.  We  next  show  that  ^CT)  is  separable  with  respect 
to  the  norm  topology,  i.e.,  in  Lp(f^,F,P). 

Assume  for  the  moment  that  | | is  uniformly  bounded  on  T.  Now 
by  (i)  it  follows  that  C(T)  is  a separable  subset  of  M with  respect  to 
the  toplogy  of  convergence  in  probability.  Thus  there  is  a countable 
subset  N of  C(T)  such  that,  for  each  teT,  there  exists  a sequence 

N converging  in  probability  to  By  [Hewitt  and  Stromberg 

1965,  p.  207]  the  sequence  converges  weakly  to  in  L (Q,F,P), 

and  therefore  the  linear  manifold  generated  by  W is  dense  in  L(0  with 
respect  to  the  norm  topology  ([Rudin  1973,  p.  65]).  It  follows  that  both 
L(0  and  C(T)  are  separable. 

Relaxing  the  above  assumption,  we  let  Tj^  = { teT: | |^^ | | < N).  Then 
00 

T,^eBCT)  and  ^(T)  = U ?(T^)  is  clearly  separable  with  respect  to  the 
N=1 

norm  topology. 

(ii)  implies  (iii) . [Hoffmann-Jfirgensen  1973,  p.  206].  If  V is 
an  open  subset  of  C(T)  in  the  norm  topology,  choose  T and 

aj^  > 0 such  that 


V = U {E,  : ||r.C  II  < a^}  . 

N=1  ^ t^ 

Then 

OO 

C'V)  = u {teT:  II  < a^}€8(T)  . 

N=1  ^ 


(iii)  implies  (iv)  is  clear. 

(iv)  implies  (iii)  follows  from  Theorem  2.1.1  and  a theorem  due  to 
B.J.  Pettis  ([Hille  1973,  Theorem  7.5.10]). 
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Ciii)  implies  (i)  is  clear  since  convergence  in  Lp(J^,F,P)  implies 
convergence  in  probability.  n 

It  should  be  noted  that  this  result  does  not  reflect  the  fact 
that  the  existence  of  a measurable  modification  is  a property  of  the 
two-dimensional  distributions  of  the  process,  as  shown  in  [Hoffman- 
Jfirgensen  1973] . 

3.1.2  COROLLARY.  A stoahastio  process  ^ as  in  Theorem  3.1.1  has  a 
measurable  modification  under  each  of  the  following  three  conditions: 

(i)  is  a weakly  continuous  process. 

(ii)  T is  an  arbitrary  interval  and  the  strong  left  (right)  limit 
of  i exists  at  all  but  countably  many  teT. 

(Hi)  T is  an  arbitrary  interval  and  i,  is  an  SaS  process  with 
independent  increments . 

Proof : (i)  If  5 is  a weakly  continuous  process,  then  F^(t)  is  a con- 

tinuous (hence  measurable)  function  of  t for  every  c,cL(0.  To  see  the 
separability  of  L(C).  let  T*  be  a countable  dense  subset  of  T and  let  W 
be  the  space  of  all  rational  linear  combinations  of  elements  in 
(5^, teT*}.  Then  N is  a countable  dense  subset  of  L(0  by  [Rudin  1973, 
Theorem  3.12],  and  the  existence  of  a measurable  modification  follows 
from  (iv)  of  Theoran  3.1.1. 

(ii)  Parts  (i)  and  (ii)(a)  of  the  proof  in  [Bulatovid  and  A^id  1976] 
for  second  order  processes  hold  with  no  alteration  for  the  process  i and 
show  that  the  set  Tj^  of  all  points  of  discontinuity  of  ^ is  countable. 

Let  T2  c T-Tj^  be  a countable  dense  subset  of  T.  Then  the  space  of  all 
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rational  linear  combinations  of  elements  in  {;;^,ttTjuT2}  is  a countable 
dense  subset  of  L(0 . It  is  clear  that  F^(t)  is  Borel  measurable  for 
every  ^eL(C)  since  it  is  a continuous  function  on  T-T^.  Thus  ^ has  a 
measurable  modification  again  by  (iv)  of  Theorem  3.1.1. 

(iii)  If  5 is  SaS  with  independent  increments,  then  Fft)  = | |C^| 1°^ 
is  an  increasing  function  which  therefore  has  at  most  countably  many  points 
of  discontinuity.  Let  T^  be  the  set  of  all  points  of  discontinuity  of 
F,  and  let  T2  c T-Tj^  be  a countable  dense  subset  of  T.  From  the  rela- 
tionship = |F(s)-F(t)|  for  all  s,teT,  it  is  easy  to  see  that 

the  space  of  all  rational  linear  combinations  of  elements  in  {^^.tcT^uT,} 
is  a countable  dense  subset  of  L(0 . For  the  measurability  of  F^(t), 
recall  from  Section  3 of  Chaptei  II  that  the  right  limit 
F^(t+0)  exists  for  all  t.  □ 

The  next  corollary  provides  a result  for  sub-Gaussian  processes 
analogous  to  the  corresponding  result  for  Gaussian  processes  ([Cambanis 
1975a]). 

3.1.3  COROLLARY.  If  L,  is  a sub-Gaussian  process,  then  it  has  a meas- 
urable modification  if  and  only  if  ICC)  is  separable  and  C^^(s,t)  is  product 
measurable. 


Proof : The  two-dimensional  c.f.'s  of  ^ are  given  by 


'^s,t*^’‘l’’'2^  " exp{- 1 |rjCg+r2^|  1“} 

_ a n 

= exp{-2  “[R(s,s)r^  + 2R(s,t)rj^r2+R(t,t)r2]^} 


where  R(s,t)  is  a covariance  function,  and  clearly 


J 
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. 1 1 
^ - ZRCt.tp)  + R(tQ.tQ)]^  _ 


Using  the  relationship  preceding  Example  2.7.1,  it  is  straightforward 

to  show  that  - 

2-g 

R(s,t)  = 2 C^^(t,t)  ^ C^^(s,t)  . 

Thus  if  C^^(s,t)  is  product  measurable,  then  so  is  R(s,t),  and  hence 

I I I measurable  in  t for  each  fixed  tp,eT.  Assuming  L(0 

t to  u 

separable,  the  existence  of  a measurable  modification  therefore  follows 
from  (ii)  of  Theoran  3.1.1. 

Conversely,  if  C has  a measurable  modification  n>  then  we  can  see 


from  Proposition  2.1.2  and  Fubini's  theorem  that 

is  a product  measurable  function  on  TxT  and  that  | Ug | | = Mbgl I is 

a measurable  function  on  T.  From 

2MfiCg+T2f,^|  1^  = r^R(s,s)  + 2rjr2R(s,t)  + r^(t,t) 
for  all  one  has 

2||Cg+Ctll^  = R(s,s)  + RCt.t)  + 2RCs,t) 


and  thus 


CgM  = R(S.S)  , 
R(S,t)  = I Ug+^l 


Consequently,  R(s,t)  is  product  measurable  and  the  product  measurability 
of  C^^(s,t)  now  follows  from 


C^f(s,t)  = 


2 ^RCs.tl 


R(t,t) 


For  a general  SoS  process  ^ it  appears  that  C (s,t)  product  meas- 
urable  and  L(0  separable  are  not  sufficient  for  the  existence  of  a 
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measurable  modification,  though  we  do  not  have  a counterexample.  Since 
I I I cannot  be  expressed  in  terms  of  C j.(t,tf,)  for  1 < a < 2,  we 

cannot  express  the  condition  for  a measurable  modification  in  terms  of 
C^^(t,tQ)  except  in  the  sub-Gaussian  case  (Gaussian  when  a = 2) , where 

2 ^ 2 

If  we  set  o(s,t)  = | then  of  course  product  measurability 
of  o(s,t)  implies  measurability  of  o(t,tQ)  in  t,  for  each  fixed  tp. 
Conversely,  if  L(0  is  separable  anda(*,tQ)  is  measurable  for  each  t^eT, 
then  (ii)  of  Theorem  3.1.1  implies  the  existence  of  a measurable  modifi- 
cation n and  we  can  apply  Fubini's  theorem  to  show  that  o(s,t)  = 

Ilns^Htll  is  product  measurable.  Hence  condition  (ii)  in  Theorem  3.1.1 
may  be  written  in  the  more  synmetric  form: 

(ii)'  The  map  T LiQ  has  separable  range  and  the  funoticn 
o(s,t)  = lUs-qll  is  -measurable. 

Finally,  we  note  that  if  ^ is  SoS  and  L(0  is  separable,  then  ^ has 
an  integral  representation  of  the  type 

• 

where  (r.^,  - ^ < u < i)  is  a SoS  process  with  independent  increments, 

lUull'*  ■ f(ti),  and  f^(Oeh^(dF)  for  all  t ([Kuelbs  1973,  Theorem  4.2]). 
And  conversely,  if  ^ has  such  a spectral  representation,  then  L(f,)  is 
separable  since  L(q)  is  separable  (Corollary  3.1.2  (iii)).  In  particular, 
every  measurable  SmS  process  has  such  a spectral  representation. 
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2.  Integrability  of  sample  paths  of  SaS  processes. 

In  this  section  we  apply  a result  due  to  DeAcosta  to  obtain  a neces- 
sary and  sufficient  condition  for  almost  all  saiiple  paths  of  an  SoS 
process  to  belong  to  Lp(T,A,v),  1 < p < a (Theorem  3.2.4).  We  also 
show  that  a san^^le  path  integral  of  an  SaS  process  is  an  SaS  random 
variable  (Lemma  3.2.3). 

3.2.1  [DeAcosta  1975]  If  u is  an  SaS  Bovel  probability  measure  ok 
Lp(T,A,v)  uith  measurable  seminorm  w ^ then  for  every  r < a, 

/ w^dy  < 


We  begin  by  proving  a lemma  involving  a p-th  order  process. 


3.2.2  LEMMA.  Let  (T,A,v)  be  a finite  measure  space,  and  let 
^ = (^^jteT)  be  a measurable  p-th  order  process  with  1 < p < «>  and 
with  I 1 I I < M < «>  for  all  teT.  For  any  element  feL  (T,A,v),  where 
i + ^ = 1,  the  sample  path  integral 


belongs  to  L(C)- 


/ f(t)C.(w)v(dt) 
T 


Proof : From  the  measurability  of  ^ jind  Fubini's  theorem,  we  get  that 

r^((j)eLp(T,A,v)  a.s.,  since 

f/)f;^((ii)  Pv(dt)  = /I  1^^  I |Pv(dt)  < M^vCT)  < «>  . 

Therefore  /f(t)f,^((jj)v(dt)eLp(n) , since 


99 


L 

E|/  f(t)r  (u))v(dt>|P  < [Mf(t)|'>vfdt)l‘^E/|f.JaO|''vfdt)  . 

T T 

In  particular,  the  random  variable  /f (t)^^(w)v(dt)  defines  a continuous 

linear  functional  on  L(0*,  and  it  follows  from  Theorem  2.1.5  and  the 
reflexivity  of  L(0  that  there  exists  a unique  neLCO  satisfying 

= A f/  f(t)rv(dt)) 
s ^ T ^ 

for  all  CeLCO. 

Given  any  c'eLp(Sl),  we  apply  Theorem  2.1.5  to  obtain  i;eL(0  such 
that  A^  = A^,  on  1(5).  Then 

A^,(n  - / f(t)5^(ui)v(dt)) 

4 rp  L 

= A ,(n)  - E[C5’)P'V  f(t)5tv(dt)] 

= A .(n)  - / f(t)E[(5’)P'^5Jv(dt) 

C,  »p  L 

= A^(n)  - / f(t)A^ (C^)v(dt) 

= A^(n)  - Ajj  f(t)5^v(dt))  = 0 . 

Thus  n = / f (t)5^(w)v(dt)  a.s.,  whence  / f (t) 5^(01) v(dt)e  1(5) . □ 

We  next  prove  a stronger  version  of  Lemma  3.2.2  for  an  SaS  process 
by  using  a truncation  suggested  by  L.A.  Shepp  and  used  in  [Rajput  1972, 
Proposition  3.2],  where  a similar  result  is  proved  for  Gaussian  processes. 

3.2.3  UmA.  Lrt  (T,A,v)  /■£?  a a-f  inite  measure  space,  and  let 
5 = (L^.tfT)  }>c  a measurable  SaS  process  uith  5(*»w)  Lp(T,A,v)  a.s.. 
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where  1 < p < a.  Then  for  every  element  feL^(T,A,v),  where  ^ ^ 

the  sample  path  integral 

belongs  to  L(0  and  is  thus  a SotS  random  variable. 

Proof : For  each  integer  n > 1 define  a truncated  process  by 

and  assume  for  the  moment  that  v(T)<  Then  the  sample  path  integral 

/ f (<i))v(dt)  belongs  to  L(0  by  Lemma  3.2.2,  and,  by  the  dominated 

T 

convergence  theorem, 

I £(t)C^''^(u))v(dt)  ->  / f(t)C.(co)vCdt)  a.s. 
fj»  t T ^ 

as  n ^ oo.  Because  almost  sure  convergence  implies  convergence  in  L(0 

for  an  SoS  process  we  therefore  have  that  / f (t)^^ (w)v(dt)  belongs 

T 

to  LCC). 

oo 

If  V is  a a-finite  measure,  let  be  a monotone  increasing 

OO 

sequence  of  elements  of  A such  that  v(T  ) < » for  every  m and  U T = T. 

^ m=l  ^ 

Then 

{/  f(t)^Jc)XT. 

T m 

in  a sequence  in  L(f;)  that  converges  to  J f (t)r,^(oj)v(dt)  by  the  domi- 

T 

nated  convergence  theorem.  □ 

3.2.4  THEOREM.  Let  (T,A,v)  be  a a-finite  measure  space,  let  (C^,tcT} 
l>e  a measurable  SotS  process,  and  suppose  that  LpCT,A,v)  is  separable. 
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where  1 < p < a.  Then  /|^.  pv(dtl  < «>  a.s.  if  and  only  if 

T ^ 

I E(KjP)v(dt)  < » . 

This  result  for  a = 2 is  contained  in  [Rajput  1972,  Proposition  3.4]. 

Note  that  Proposition  2.1.2  provides  an  expression  for  ECj^^p)  in  terms 
of  the  covariation  of  E on  the  diagonal. 

Proof:  Sufficiency  is  clear.  For  the  necessity,  define  the  map 

$:  -»■  Lp(T,A,v)  by 

f C(’.w)  if  C(*,co)eL  (T,A,v)  , 

$(0))  = P 

[ 0 otherwise  . 

Then  <I)  is  a measurable  map  from  C^.F)  to  (Lp,B(Lp)),  since  the  process  E 
is  measurable  and  Lp(T,A,v)  is  separable.  Thus  ^ induces  a measure  u 
on  Lp(T,A,v)  by 

p(B)  = P<d'^B) 

for  all  BeBCLp).  If  f€L^(T,A,v),  ^ ^ “ hand  if  f*  denotes  the  element 

of  L*  (T,A,v)  correspond iilg  to  feL^CT,A,v),  then  we  have  that  f*(CC’>w)) 

= / f (t)E*(o))v(dt)  defines  an  element  of  L(0  by  Lemma  3.2.3.  Therefore 

T .1 

p(f*l  is  an  SoS  distribution  on  R,  since  for  every'  Borel  subset  B of  R, 

p(f*)'l(B)  = P<I>'^{x£l^(T,A,v):  f*[x)tB} 

= P{(i)€f2:  f*(f.(*  ,(i)))t'B}  . 

Thus  p is  an  SoS  measure  on  Lp(T,A,v),  so  that  by  result  3.2.1  of 
DeAcosta 

/ B(|E.|P)v(dt)  = E /|E.|Pv(dt) 

T r .p  r 

= /|lE(-,a)]||P  P(du)) 

Lp(T) 


3.  Absolute  continuity  of 


f- 


I 


L 


sample  paths. 

In  this  section  we  obtain  sufficient  conditions  for  the  sample 
paths  of  a p-th  order  process  to  be  absolutely  continuous  (Theorem 
3.3.1)  and  show  these  conditions  to  be  also  necessary  when  the 
process  is  SaS  (Theorem  3.3.3). 

If  B is  a Banach  space  with  norm  1 | • 1 | and  T = [a,b]  is  an  inter- 
val of  R,  then  we  write  L^[T,B]  for  the  space  of  Borel  measurable 
functions  f:  T -►  B such  that  | |f(t)  | |eLj^(T,Leb) . We  call  f absolu- 
tely continuous  if  for  every  e > 0 there  exists  a 6 > 0 such  chat 
for  every  disjoint  family  { (Sj^,tj^)  of  subintervals  of  T> 

^k=l*-^k'^k^  " implies  that  | | f (tj^) -f  (sj^)  1 | < e.  The  following 

characterization  of  absolute  continuity  is  given  in  [Brezis  1973, 

Appendice] : the  function  f : T ^ B is  absolutely  continuous  if  and 

only  if  for  every  teT  it  can  be  expressed  in  terms  of  a Bochner  integral 

t 

f(t)  = f(a)  + / ?(s)ds 
a 

where  feL^ [T, B ] . 

We  now  present  sufficient  conditions  for  a p-th  order  process  to 
have  absolutely  continuous  paths.  The  argument  used  is  from  [Cambanis 
1975b]  where  second  order  processes  are  considered. 

3.3.1  THEOREM.  Let  C = (C^jteT)  be  a separable  p-th  order  process  on 
(fJ,F,P),  where  p > 1 and  T = [a,b]  . Then  each  of  the  following  two 
equivalent  conditions  is  sufficient  for  the  seonple  paths  of  C to  be 
absolutely  continuous  irLth  probability  one  (and  have  a measurable  p-th 
order  process  as  derivative) : 

J 
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(i)  The  map  T -►  L(^)  defined  by  t absolutely  continuous, 

(ii)  The  function  is  absolutely  continuous  for  all 

Cel.(5),  for  all  teT-T^  with  Leb{l^  = 0 the  derivative  C^^(t)  exists 


for  all  CeL(5),  and 


l\  |5^l  |clt  < ” , 

rri  ^ 


where  for  each  teT-Tp,  is  the  unique  element  of  L(^)  satisfying 
A^(Ct)  = C’^(t)  for  all  Ce/-(C). 

Proof : The  equivalence  of  (i)  and  (ii)  is  contained  in  [Brezis  1973, 

p.  145].  If  t |— > is  absolutely  continuous,  we  have 

«t  ■ 5a  ♦ 

a 

for  all  teT  where  |cL^[T,l(5) ] . By  Theorem  3.1.1,  ^ has  a measurable 

modification,  say  n.  Observe  that 

b b b ^ 

E / |n(t,o))|dt  < / ||n(t,a))]L  . .dt  = / ||L|L  °°  ’ 

a a p*-  a p^ 

so  n(’ >w)eL2^(T,Leb)  a.s.,  i.e.  , for  every  ojeO-OQ  with  P(0q)  = 0. 


Define  X by 


X(t,o))  = 


E(a,o))  + / n(s,o))ds,  teT,  weQ-Q.  , 


, teT,  u)eO^  , 


and  note  that  the  sample  paths  of  X are  absolutely  continuous. 

A 

Let  be  a sequence  of  simple  functions  T ^ L(^)  such  that 


a p^ 


for  all  teT.  Then 


t 

= E|/  - / Tigdsl 


t 

= lim  El/  Cj^(s)ds  - / n(s)ds| 
n-K»  a a 


< lim  / E|Cj^(s)  - n(s)  Ids 
n-»°  a 


< lim  / llC^(s)  - n(s)llL  (fi)ds  n . 
n-^  a p 

Thus  = X^}  = 1 for  all  teT.  Let  S be  a separating  set  for  C 

with  McF,  P(N)  = 0,  such  that  if  coeSl-N  and  teT-S,  then  ?(t,03)  = 

lim  C(s,w).  Now  P(C^  = X , VteS}  = 1.  Thus  there  exists  with 

s^t 

seS 

PCQj)  = 0 such  that  C(t,w)  = X(t,co)  for  all  teS  and  Given 

any  tcT-S  and  any  , 

C(t,w)  = lim  C(s,cj)  = lim  X(s,to)  = X(t,o))  , 
s->-t  s->t 

seS  seS 

since  the  paths  of  X are  continuous.  Tlius,  if  wcfl- , then 
5(t,to)  = X(t,w)  for  all  teT,  and  hence  the  sample  paths  of  5 are  abso- 
lutely continuous  with  probability  one.  D 


In  [Cambanis  197.^1  it  is  shown  for  a separable  Gaussian  process  E 
that  at  every  fixed  teT  the  paths  of  E are  continuous,  or  differentiable, 
with  probability  zero  or  one.  Also,  if  E is  measurable,  then  with 
probability  one  its  paths  have  essentially  the  same  points  of  differen- 
tiability and  continuity.  These  same  results  follow  for  SaS  processes 
(with  no  change  in  argument)  by  applying  a zero-one  law  for  stable 
measures  from  [Dudley  and  Kanter  1974] . We  now  state  in  detail  one 
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of  these  results  which  will  be  used  later. 

3.3.2  THEOREM.  [Cambanis]  Let  L,  = {^^:teT}  be  a separable  SaS 
process,  where  T is  any  interval. 

(i)  At  every  fixed  point  teT  the  paths  of  C are  differentiable 
with  probability  zero  or  one. 

( ii)  Let  Tj  be  the  set  of  points  t in  T where  the  paths  of  ^ 
are  differentiable  with  probability  one,  and  T^(w)  be  the  set  of  points 
t in  T where  the  path  ^(*,03)  is  differentiable.  If  5 is  measurable, 
then  with  probability  one 

Leb{Tj(uj)  A Tj}  = 0 . 

The  next  result  shows  that  the  conditions  in  Theorem  3.3.1  are 
necessary  for  a SaS  process  C-  Once  again,  we  use  the  proof  of  a 
similar  result  in  [Cambanis  1975b]  for  Gaussian  processes,  certain 
passages  being  lifted  in  their  entirety. 

3.3.3  THEOREM.  Let  L,  = {C^,tcT}  be  a separable  SaS  process  with 
T = [a,b]  and  a > 1.  Then  the  following  are  equivalent: 

(i)  The  paths  of  C are  absolutely  continuous  with  probability  one. 
(ii)  The  map  T defined  by  t |— > ^ is  absolutely  continuous. 

(Hi)  The  function  C^^(t)  = is  absolutely  continuous  for  all 

CsL(C),  for  all  tcT-T^  with  AefeCTp)  = 0 the  derivative  CI_(t)  exists 
for  all  LtL(Fj,  and 

f I |dt  < - , 

T ^ 

/s 

where  for  each  tcT-T^,  is  the  unique  element  of  satisfying 

\(^t)  " 
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Proof:  (i)  (iij.  Absolute  continuity  of  a path  implies  differ- 

entiability a.e.  [LebJ  , and  therefore  Leb[T-Tj((j)  ] = 0 a.s.  Since  ^ 
has  continuous  paths  with  probability  one,  it  is  measurable.  Thus 
by  Theorem  5.3.2,  Leb[Tj(o))  A T^]  = 0 a.s.,  and  hence  Leb(T-T^)  = 0. 
Take  Tq  = T-Tj,  and  let  with  P(.Qq)  = 0 be  such  that  is 

absolutely  continuous  for  all  loen-^Q.  Define  c by 


C(t,U))  = { 


limsup  n[C(t+  -,o)) 

n-KJo 


0 


C(t,(jj)],  te[a,b),  , 

te[a,b),  ajeSlp;  t=b,  (jjeJl  . 


Then  c is  measurable  and  for  all  u)€J1-Qq  we  have  c(t,a))  = F'(t,(jLi)  for 
teTj(w)  - {b},  where  ^'(*,00)  denotes  the  path  derivative  of  F(’,w). 
Also,  for  all  teT^  - {b} , ^(t,uj)  = ^'(t,u))  a.s.  Now  define  n by 


|^(t,o)),  teT  , , u)eQ  , 

n(t,o))  = 

^ 0 , teTp,  wefl  , 

and  note  that  n is  measurable  and  SaS.  Also,  for  all  wefi-flQ, 


n(*,w)  = = C'(*,w)  a.e.  [Lcb] 

on  T,  and  C (•  ,u))eLj  (T,  Leb)  since  is  absolutely  continuous.  It 

follows  that  n(*  .w)eL2(T,Leb)  , and  hence  / < «=  by 


the  remark  following  Theorem  3.2.4.  In  addition,  for  wefl-JlQ,  we 
have 

t 

Z(t,cj)  = £;(a,u))  + / n(s,w)ds 
a 

for  all  teT. 

Lot  I 3 family  of  disjoint  subintervals  of  T.  Ihcn 

n ^k 


^ I l^’t  '^s  I ll  fn)  n(s,o))ds| 

k=l  ^k  - k k=l  s, 
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n 


Therefore  the  map  t I— > is  absolutely  continuous  by  the  absolute 

continuity  of  the  indefinite  integral  since  / ||n  1 1,  ^ “ • 

/p  S Lj  titj 


(ii)  =>  (i)  and  (ii)  <=>  (iii)  follow  from  Theorem  3,3.1. 


□ 


Theorans  3.3.1  and  3.3.3  with  appropriate  modifications  give  condi- 
tions for  paths  to  be  absolutely  continuous  with  derivatives  in 
Lp(T,Leb).  They  can  also  be  extended  to  give  conditions  for  paths  to 
have  (n-1)  continuous  derivatives  with  the  (n-l)-th  derivative  absolu- 
tely continuous  with  derivative  in  Lp(T,Leb). 

The  followirjg  corollary  generalizes  a well  known  result  for  station- 
ary Gaussian  processes  to  the  (nonstationary)  SaS  case. 

3.3.4  COROLLARY.  Let  -°°  < A < °^}  be  a SaS  process  with  indepen- 
dent increments  and  F(X)  = | a bounded  function.  Then  a separable 

stochastic  process  a<t<b}  defined  by 

00 

= / cos(tA)d<;^ 

-00 

has  absolutely  continuous  sample  paths  with  probability  one  if  and  only 

if  «> 

/ |A|“dF(A)  < ® . 

-OO 

Proof : If  f,  has  absolutely  continuous  sample  paths,  then  for  even’ 

OO 

gcL^(dF)  and  f,  = / g(A)dc^, 

-OO 

CO 

C (t)  = / cos(tA)(g(A))“'^dF(A) 

^ ’ -OO 

is  absolutely  continuous  on  [a,bj  by  Theorem  3.3.3.  Thus  for  any 
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1/a-l 


00 

/ cos(tA)f>Q(A)dF(A) 

-00 

is  absolutely  continuous  on  [a,b].  It  is  known  that  a function 

oo 

f(t)  = / cos(tA)dy(A) , y finite,  is  absolutely  continuous  if  and  only 

-OO 

oo 

oo 

if  / |Aldy(A)  < Therefore  / | A | gQ(A)dF(A)  < °°  for  every  positive 

-00  -oo  oo 

function  follows  that  / jAl'^dFCA)  < 

For  the  converse,  note  that  ev'ery  CeL(5)  can  be  expressed  as 

oo 

c = / g(A)d^^,  where  geL^(dF) , If  AeL^(dF) , then 


and  therefore 


1 

/ lAl|g(A)|“'MF(A)  < 


C (t)  = / cos(tA)(g(A))'"'-'dFfA) 

-on 


is  absolutely  continuous.  It  is  easily  seen  that  C^^(t)  exists  at 
every  te(a,b)  and  that 

00 

= - / A sin(tA)dc^ 

-OO 

satisfies  C^^(t)  = for  all  ^eL(0-  Thus 

b ^ b 

I I l^tl  |dt  = / I I A sin(tA)  I Ij  „,.dt  V cx.  , 
a a ‘a 

and  therefore  the  paths  of  ^ are  absolutely  continuous  with  probability 
one  by  Theorem  3.5.3.  G 


It  should  be  remarked  that  a SaS  process  C = a<t<b}  with 

independent  increments  cannot  have  absolutely  continuous  sample  paths 
(except  in  the  trivial  case  where  F(t)  = 1U^||“  is  a constant  function) 
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For,  the  claim  is  obvious  if  F is  not  absolutely  continuous  with  re- 
spect to  Lebesgue  measure.  In  the  case  of  absolutely  continuous  F, 

< 

given  any  e > 0 and  6 > 0 it  is  possible  to  choose  a finite  family  of 
disjoint  subintervals  { such  that  - <5,  but 


I ll?t  -^s  N = I 


,1/a 


> e 


k=l 


k=l 


To  see  this  case,  let  (a^.bj)  be  a subinterval  of  [a,b]  such  that 
bf-ai  < 6,  F(bj)-F(aj^)  > 0,  and  define 


h = 


F(bp  - F(a^) 


ae 


a/a-1 


By  the  uniform  continuity  of  F we  can  choose  n so  large  that  |t-s|  < - 
implies  lF(t)-F(s)]  < h,  for  all  s,te[a,b].  Let  { (Sj.,tj^)  be  a 
partition  of  (a^.b^)  into  n subintervals  of  equal  length.  Then 

n n F(ti.)-f(sJ 

I |f(h)-f(s^)F'“  > I ^ ■ 


k=l 


k=l  ah 


i 
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